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SUMMARY 


The development of engineering requirements for man-in-the 
loop simulation is a complex task involving numerous trade-offs 
between simulation fidelity and costs, accuracy and speed, etc. 
The design of the simulation model has become increasingly 
important and difficult as digital computers play a more cen- 
tral role in the simulations. For real-time digital simulation 
with a pilot in the loop the design problem involves specifica- 
tion of conversion equipment (A-D and D-A) as well as of the 
discrete model of the system dynamics. 

The objective of the work reported here was to develop a 
closed loop analytic model, incorporating a model for the human 
pilot, (namely, the optimal control model) that would allow 
certain simulation design tradeoffs to be evaluated quantita- 
tively and to apply this model to analyze a realistic flight 
control problem. The effort concentrated on the dynamic, 
closed loop aspects of the simulation. Problems associated 
with perceptual issues in cue generation are not considered. 
However, the limitations imposed by the dynamics of visual cue 
generation equipment are considered. 

The human pilot in closed loop control will operate on 
essentially continuous outputs to generate continuous control 
inputs. Thus, even when digital computers are used in an 
aircraft simulation, it is meaningful to consider a continuous 
transfer function approximation to the open loop simulation 
dynamics. Such an approximation is developed in this study. 

It consists of a rational transfer function multiplied by a 
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transportation lag. The rational transfer function approxi- 
mates the amplitude distortions introduced by discrete integra- 
tion of the flight dynamics. The delay accounts for all the 
phase lags introduced by the simulator components. These phase 
lags are the major source of degraded performance and increased 
workload in closed loop tasks. However, the amplitude distor- 
tions can be significant for open-loop responses. 

The approximate model is then incorporated in the standard 
optimal control model for the human operator. The resulting 
continuous closed-loop model is used to analyze both overall 
simulation effects and the effects of individual elements. 

The results show that, as compared to an ideal continuous simu- 
lation, the discrete simulation can result in significant per- 
formance and/or workload penalties. The magnitude of the 
effects depends strongly on sample period as expected. 

In addition to the continuous model, a hybrid model is 
developed to investigate situations that could not be treated 
adequately with the continuous model. The hybrid model is 
used to investigate the effects of improper pilot adaptation 
to the simulator configuration and to explore the interactions 
between closed loop performance and the design parameters in 
the dealiasing filter and data reconstructor. 

A preliminary validation of the continuous model is per- 
formed by comparing model results with data obtained in an 
independent experiment. The model prove's capable of predicting 
the effects of computational delays in generating visual cues, 
once model parameters are chosen to match basic conditions. 
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INTRODUCTION 


1 . 

The development of engineering requirements for man-in-the- 
loop digital simulation is a complex task involving numerous 
trade-offs between simulation fidelity and costs, accuracy and 
speed, etc. The principal issues confronting the developer of 
a simulation involve the design of the cue (motion and visual) 
environment so as to meet simulation objectives and the design 
of the digital simulation model to fulfill the real-time require- 
ments with adequate accuracy. 

In specifying the cue environment the designer must establish 
the need for particular cues as well as the requisite fidelity of 
presentation. The choices made here are highly important because 
the validity and utility of the simulation results can be criti- 
cally dependent upon them and because the decisions involve major 
costs in the simulation. (Cue generation equipment is generally 
very expensive to buy and maintain and, even when available, its 
inclusion will involve additional cost because of the added simu- 
lation complexity.) Unfortunately, the decisions are quite diffi- 
cult to arrive at rationally, inasmuch as the choices depend on 
complex psychological as well as engineering factors'. The require 
ments will be governed by the purpose of the simulation: training 

simulators have different needs than research simulators. They 
will also be problem dependent (e.g., the need for motion cues 
in the analysis of aircraft control in a gusty environment will 
depend on the gust response of the aircraft). Finally, the capa- 
bilities of the human controller both help and compound the prob- 
lem. The human pilot may be able to compensate for simulator 
shortcomings and maintain system performance at the expense of 



workload (assuming the real cues are helpful, an assumption that 
is not always valid) . In such a situation, the pilot could give 
a degraded evaluation of the system that would be unwarranted. 

The design of the simulation model has become increasingly 
important and difficult as digital computers play a more central 
role in the simulations. For real-time digital simulation with 
a pilot in the loop the design problem involves specification of 
conversion equipment (A-D and D-A) as well as of the discrete 
model of the system dynamics. The design of an adequate discrete 
simulation is also related closely to the cue generation problem 
inasmuch as the errors and, in particular, the delays introduced 
by the simulation will be present in the information cues utilized 
by the pilot. The significance of this problem has been amply 
demonstrated, most recently in the ASUPT experience [1] . Of 
course, human pilots can compensate for model shortcomings as 
well as for those of cue generation, again with possible effects 
on the subjective evaluation of the simulation. 

"Rules of thumb", open loop response measurements and sub- 
jective feedback from pilots are all helpful in developing the 
engineering requirements for simulators. However, for simula- 
tions in which the operator's principal task is flight control, 
it would be most useful to have analytic models that would allow 
one to explore the inevitable tradeoffs quantitatively in a closed 
loop control context. There has been considerable research into 
the problems of developing digital models that simulate ade- 
quately continuous control systems. Models have been proposed 
based on standard numerical methods for integration of dynamical 
equations of motion, the use of operational methods (particularly 
z-transforms) and the use of specialized integration schemes [2-4] . 
The thrust of this research has been to develop techniques that 
will allow the digital simulation to respond in the same fashion 
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as the continuous system being simulated without requiring inor- 
dinate computation times (as might ordinarily be dictated by 
the relatively high bandwidths of many control systems) . These 
studies have considered both open- and closed-loop systems, but 
they have ignored the problems associated with a human closing 
the loop. Insofar as the human controller differs from those 
considered previously (in adaptivity, noise injection properties 
and in an ability and propensity to trade performance and work- 
load) , prior analytic work on digital simulations of control 
systems is inadequate for defining requirements for piloted 
simulations . 

The objective of the work reported here was to develop a 
closed loop analytic model, incorporating a model for the human 
pilot, that would allow certain simulation design tradeoffs to 
be evaluated quantitatively and to apply this model to analyze 
a realistic flight control problem. The effort concentrated on 
the dynamic, closed loop aspects of the simulation. Problems 
associated with perceptual issues in cue generation were not 
considered. However, the limitations imposed by the dynamics 
of cue generation equipment and the effects of adding or omitting 
information are amenable to treatment by the resulting model. 

The optimal control model of the human operator [5-7] is 
central to the closed loop analysis techniques to be employed. 
This model has been validated and applied extensively and has a 
structure that is well-suited to analysis of the simulation prob- 
lems of interest. The model can be used to generate predictions 
of attentional workload as well as of closed-loop performance. 
This is significant because, as noted earlier, pilots may com- 
pensate for simulation shortcomings but with a workload penalty; 
such simulation- induced operator tradoffs need to be explored. 
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Two approaches to the development of a closed-loop model have 
been employed in this study. First, a continuous approximation 
to the open- loop dynamics of the digital simulation was developed. 
This approximation can be used with the existing implementation 
of the optimal control model to explore performance/workload 
penalties associated with the simulation. Although it was believed 
that such an approach would be satisfactory for most applications, 
a second, more exact, approach to model development was also con- 
sidered to assure that the approximations of the continuous model 
were valid. In particular, a simulation version of the optimal 
control model was used to control an exact representation of the 
discrete simulation dynamics; in this model, those portions of 
the closed loop simulation that correspond to continuous elements 
I (including the human) operate at a significantly higher sample 
I rate than those corresponding to discrete elements (which operate 
at simulation sample rates) . We have called this latter model 
the hybrid model for obvious reasons. 

In the remainder of the report we develop and apply the two 
models. In Chapter 2, the elements of the discrete simulation are 
described and the continuous model approximation for the closed- 
loop simulation is developed. The hybrid model is described in 
Chapter 3. Results of applying the closed-loop models to a poten- 
tial simulation of an F8 target tracking problem are presented in 
Chapter 4 along with a preliminary validation of the model. 

Chapter 5 contains concluding remarks . 


2 . 


CONTINUOUS CLOSED-LOOP MODEL OF SIMULATION 


Figure 1 is a generalized block diagram of a digital closed- 
loop, piloted simulation. The analysis of the implications of 
various options and tradeoffs on closed-loop performance and 
workload is the problem of interest here. Below, we discuss in 
general terms the elements of the loop and then develop a con- 
tinuous model for the simulation that can be used in conjunction 
with the optimal control model for the pilot, 

2.1 Simulation Description 

2.1.1 Analog to Digital Conversion 

The human controller is assumed to generate a continuous 
control input (or vector of inputs) . This continuous or analog 
signal must be converted into a discrete variable for utilization 
in the digital simulation of the vehicle dynamics. This process, 
usually referred to as sampling, produces errors in the simu- 
lation. Some errors arise because actual samplers are non-ideal 
(e.g., sampler jitter, aperture errors). For well-designed 
samplers, errors that are inherent in the sampling operation 
itself are most important. 

The well-known sampling theorem states that the sampling 
frequency must be at least twice the highest frequency component 
of the analog signal being sampled. In applying the theorem, 
the highest frequency occurring in the signal (and not the high- 
est frequency of interest) determines the required sampling 
frequency. For reasonable accuracy of the reconstructed signal 
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Figure 1. - Simplified Model for Closed Loop Analysis of Digital Simulation, 










r 


a much larger sampling frequency is frequently used C[8] 
suggests a value of at least ten times the highest frequency 
component). Nevertheless, to prevent aliasing of unwanted high 
frequency signals (e.g., from noise in the analog portions of 
the system or from wide-band remnant injected by the human con- 
troller) , the input to the sampler is normally low-pass filtered. 
The design of this filter is part of the simulation design. A 
common choice for the ADC pre-filter is a Butterworth filter 
which has the desirable property of a flat amplitude response 
out to the filter cut-off frequency This cut-off frequency 

(and the filter-order) are design parameters. One would like 
to select CO to minimize aliasing problems while passing the 
frequencies of interest. However, the filter introduces phase 
shift and the lower the value of co^ the greater the phase lag 
of the frequencies of interest. This unwanted lag adds to the 
computation time lags in the digital simulation and could exa- 
cerbate an already serious problem. 

2.1.2 Discrete System M odeling 

For the problems of interest, differential equations of 
motion will have to be "integrated" using discrete methods; i.e., 
by replacing the differential equations by appropriate difference 
equations. Methods for accomplishing this in general and for the 
special case of modeling continuous control systems have been 
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the subject of extensive research. Principally, the approaches 
have involved numerical methods, operational methods (particu- 
larly z-transforms) and, to a lesser extent, sampled-data control 
theory. Whatever the approach, the major concerns are accuracy, 
stability, speed and programming ease. Generally speaking, two 
types of errors are introduced by one step of the integration 
process, namely round-off and truncation errors. Truncation error 
is a function of the integration method used, whereas round-off 
error is a function of the word length of the computer. The 
manner in which these errors propagate is determined by the sta- 
bility of the numerical method, the computer program and the 
problem itself. 

While in non-real time applications computation time is a 
practical consideration, in the problems of interest here it is 
a design specification. The necessity for matching the simula- 
tion time-base to that of the human controller limits the com- 
plexity of the numerical integration schemes that can be employed. 
On the other hand, given the feedback nature of the system and 
the sampling frequencies that must be used because of the human, 
numerical accuracy errors are usually of secondary importance. 

Of primary importance for closed- loop control problems 
are the phase-shift (or delay) and amplitude distortion intro- 
duced by the integration process . Many integrators have been 
analyzed to determine their phase and amplitude characteristics 
(see e.g., [2]) and methods for compensating such integrators, 

both continuously and discretely, have also been studied (e.g., 
[3]). Many of the methods have considered matching the total 
digital simulation loop to that of the continuous control system. 


8 



Thus, the integration scheme is considered in conjunction with 
the data reconstruction process and other system elements. The 
overall digital simulation system is "compensated" so as to 
achieve some desired goal such as matching the static gain and 
closed-loop eigenvalues of the continuous system [4] . 

Here, we will be primarily interested in the overall dis- 
tortions introduced by discrete integration of aircraft dynamic 
equations of motion and in developing continuous models reflect- 
ing those distortions. This will be discussed in detail in 
Section 2.2. 

2 • 1 • 3 Digital to Analog Conversion (Data Reconstruction) 

The discrete simulation model produces outputs at discrete 
times which must be converted to continuous inputs for process- 
ing by the human operator. This involves some sort of data 
reconstruction process. Based on sampling theory, an ideal low 
pass filter is needed to recover the wanted information while 
eliminating the undesirable high frequency outputs that are a 
result of the sampling. Such filters cannot be achieved prac- 
tically, and data reconstruction is accomplished by some form 
of " data-holding" . The choice of the data reconstructor is open 
to the designer, with the tradeoffs involving complexity, accu- 
racy and speed. In general, the higher the order of the data 
reconstruction process the sharper the amplitude characteristic 
cuts off. However, distortion of high frequencies in the band 
of interest and increased phase lag also usually result from 
increased order reconstruction. In our subsequent analysis, we 
will limit consideration to zero-order and first-order holds 
for data reconstruction. 
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2.1.4 Cue Generation (Display Dynamics and Control Loading) 

The cue generation simulation is simplified considerably 
in Figure 1, in keeping with the limits of this program. In 
particular, we show only a servo system that might be associated 
with generating visual cues. The basic idea is to attempt to 
consider the effects of dynamics in generating visual cues 
without getting deeply involved in problems related to the 
perception of these or other cues. Thus, the model accounts 
for the information available and the dynamics involved in 
presenting that information.* 

A block modeling control loading is also included in Figure 
1. The analysis of control loading will be limited to examining 
the effects of digital generation of the loading forces on 
closed-loop performance. The subtleties associated with percep- 
tion of force feedback or of subjective evaluations of control 
loading will not be explored. These problems are, of course, of 
major importance in deciding on the requisite cue simulation but 
they are left to future study. 

2.1.5 Optimal Control Model for Pilot 

The optimal control model (OCM) of the human operator is 
illustrated in Figure 2. The model has been documented exten- 
sively [e.g., 5-7]. Here some of the features of the model that 
are particularly relevant to subsequent discussions are reviewed 
briefly. Figure 2 illustrates the structure of the OCM. 


* One may also treat motion cues in a similar manner [9]. However, 
■ to limit the scope of this effort we have concentrated on fixed- 
base simulation, leaving the inclusion of motion to later study. 
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MOTOR OBSERVATION 

NOISE NOISE 


HUMAN OPERATOR MODEL 


I-* 


Figure 2.- Structure of the Optimal Control Model. 



The OCM as originally conceived and developed presupposes 
that the system dynamics , corresponding to the element to be 
controlled, may be expressed in state variable format 

x(t) = A^x{t) + B^u(t) + w(t) (1) 

= C^x(t) + u(t) 

where x is the n-dimensional state-vector, y is an m-dimensional 
vector of displayed outputs, u is the r-dimensional control input 
vector and w is a vector of disturbance and/or command inputs. 

The system matrices (ABODE) are generally assumed to be 
time-invariant, although this restriction has been relaxed in 
recent investigations [10,11]. The above system dynamics 
include the linearized dynamics of the aircraft (or other con- 
trolled element) and any dynamics associated with measurement, 
control and display systems. The subscript c on the system 
matrices is included to emphasize that the dynamics are assumed 
to represent a continuous system. 

For purposes of discussion it is convenient to consider the 
model for the pilot as being comprised of the following: (i) an 

"equivalent" perceptual model that translates displayed variables 

into noisy, delayed perceived variables denoted by y (t)*; 

P 


* A threshold is also considered part of the perceptual process, 
but may actually be used to model the effects of non-idealized 
displays. The threshold is treated by statistical linearization 
techniques . 


12 



(ii) an information processing model that attempts to estimate 
the system state from the perceived data. The information pro- 
cessor consists of an optimal (Kalman) estimator and predictor and 
it generates the minimum- variance estimate x(t) of x(t); (iii) a 
set of "optimal gains", L*, chosen to minimize a quadratic cost 
functional that expresses task requirements; and (iv) an equiva- 
lent "motor" or output model that accounts for "bandwidth" limi- 
tations (frequently associated with neuromotor dynamics) of the 
human and an inability to generate noise-free control inputs. 

The time-delay, observation- and motor-noises and the 
neuromotor- lag matrix are included to account for inherent limi- 
tations on human processing and perceptual-motor activity. 

Methods for choosing values for these quantities have been 
determined by matching experimental data and these values have 
been found to be generally independent of task parameters [5] . 

The time delay or transport lag is intended to model delays 
associated with the human. All displayed variables are assumed 
to be delayed by the same amount, viz. t seconds. Delays intro- 
duced by the simulation can be added to the human's delay without 
any problem, so long as all outputs are delayed by the same 
amount. If such is not the case, then all outputs can be delayed 
by T, where t is now the sum of the minimal delay introduced by 
the simulation and the operator's delay, and additional delays 
for the outputs requiring them can be modeled via inclusion of 
Fade approximations in the output path. 

The observation and motor noises model human controller 
remnant [12] and involve injection of wide-band noise into the 
system. This noise is "filtered"- by the other processes in the 
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pilot model and by the system dynamics. It should be emphasized 
that the injected remnant is a legitimate (if unwanted) part of 
the pilot's input to the system and, therefore, significant amounts 
of remnant power should not be filtered out in the de-aliasing 
process of a valid simulation. 

The neuro-motor lag matrix limits the bandwidth of the model 
response. Typically, for wide-band control tasks, involving a 
single control variable, a bandwidth limitation of about 10-12 
rad/sec gives a good match to experimental results (i.e., a neuro- 
motor time constant of T^ ~ .08 - .10). For many aircraft control 
tasks there is no significant gain (i.e., reduction in error) to 
be obtained by operating at this bandwidth, and there can be some 
penalty in unnecessary control activity. For such tasks larger 
time constants (lower bandwidths) have been observed. In these 
cases, if the neuro-motor time constant is arbitrarily set at 
the human's limit (say T^ ~ .1) good predictions of tracking or 
regulation performance are usually obtained; but the control 
activity and pilot bandwidth tend to be overestimated. 

It may be useful to have more accurate estimates of pilot 

bandwidth for making decisions concerning approximations to the 

discrete simulations. Therefore, T^^ was chosen in this study 

on the basis of a model analysis of the tradeoff between error 

and control-rate scores. The procedure is illustrated by Figure 

3, which is a curve showing the tradeoff between error and 

control-rate for the F-8 longitudinal short-period dynamics, 

and the target tracking input to be analyzed later in this report. 

Shown on the curve is the rate-limit for the F-8 actuator; T„ 

N 

must be chosen so that this limit is not reached or violated a 
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significant portion of the time (so the linearized analysis is 
valid). A value for of approximately .15 (an operator band- 
width of about 1 Hz) was chosen on the basis of this curve. This 
value gives an rms control rate that is less than the maximum. 

The error score exceeds that obtained with T^ = .1 by less than 
10%, while the control rate is less than half of that obtained 
with the wider bandwidth. 

The optimal estimator, predictor and gain matrix represent 
the set of "adjustments" or "adaptations" by which the human 
attempts to optimize his behavior. The general expressions for 
these model elements depend on the system and task and are 
determined by solving an appropriate optimization problem ac- 
cording to well-defined rules. Of special interest here is 
that, in the basic continuous OCM, the estimator and predictor 
contain "internal models" of the system to be controlled and 
the control gains are computed based on knowledge of system dy- 
namics. The assumption is that the operator learns these dynamics 
during training.* 

The question arises as to the appropriate internal model 
when the human controls a discrete simulation of a nominally 
continuous system. It would appear that if the operator is 
trained on the simulation, then the appropriate model corresponds 
to the simulation model.** This will be the assumption employed 
with the continuous model. 


* This is generally more convenient than assuming that the 
external model differs from the true model and also leads to 
good performance prediction [13] 

** If the sim.ulation model is poor, a control strategy that is 
inappropriate for the actual system could be learned with 
negative results in, say, transfer of training. This issue 
can be addressed with the hybrid model described later. 
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Finally, it should be mentioned that the solution to the 
aforementioned optimization problem yields predictions of the 
complete closed-loop performance statistics of the system. Pre- 
dictions of pilot describing functions and control and error 
spectra are also available. All statistical computations are 
performed using covariance propagation methods, thus avoiding 
costly Monte Carlo simulations. This is not the case for the 
hybrid model described later in Chapter 3. 
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2.2 Open-Loop Simulator Dynamics 


As noted above, the application of the standard OCM to 
closed loop analysis requires a continuous state representation 
of the complete controlled element. This state-variable des- 
cription can be arrived at from basic derivations of dynamical 
equations, or it can be developed to "match" or approximate 
the input/output characteristics of the controlled element. 

We shall develop a continuous model for the simulation utiliz- 
ing each approach to some extent. In particular, approximate 
transfer functions for the simulation will be developed first. 
Inasmuch as there is not a unique state representation corres- 
ponding to the transfer function, we will choose the form that 
corresponds to that which would be derived based on aircraft 
dynamical equations of motion. This procedure, we believe, 
provides the most insight into the changes in open-loop charac- 
teristics- introduced by the discrete simulation of continuous 
aircraft dynamics. 

2.2.1 System Function From Stick Input to Displayed Output 

Figure 4 is an elaborated diagram of the simulator portion 
of Figure 1*. Note that the output of the visual servo, y(t) , 
is a continuous signal as is the input, u(t) , to the A-D de- 
aliasing pre-filter.** We begin by deriving the system function 
that relates these two continuous quantities. 


* Control loading is neglected in this analysis, but will be 
considered in the hybrid model. 

** For simplicity, we consider single— input, single-output systems. 
The results obtained here can be generalized to more complex 
situations. 
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For analysis purposes we use the notation implied in 
Figure 4. Variables or functions with argument s represent 
Laplace transforms and those with argument z correspond to 
z-trans forms . The starred quantities correspond to Laplace 
transforms of impulse sampled signals or of functions of z and 
are defined, e.g., by [2] 


u. 


(s) 


u^ ( z) 


z=e 


s T 


1 °° 

- I u^(s+jn^^) 

n=-oo 


or 


D* (s) = D (z) 


z=e 


s T 


( 2 ) 


(3) 


where 




ll 

T 


sampling frequency. 


(4) 


From Figure 4, we obtain 

y(s) = F 2 (s)yj^*(s) = F 2 (s)D *(s)u^*(s) 

(5) 

y(s) = F 2 (s)D*(s)|i I Fi (s + jnS^) u (s+ jnf^) | 


Equation (5) gives the exact transfer relation between u(s) and 
y(s). However, it is not a useful expression from the standpoint 
of closed-loop modeling because of the infinite summation. 
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r 


The system function, G(s) , for a linear system (such as 
the simulation system under analysis) may be obtained by com- 
puting the steady-state response of the system to an input of 
st 

the form e . That is. 


G(s) = 


u (t) = e 


st 


It is shown in Appendix A that the system function from u(s) to 
y(s) (in steady-state) is given by* 


u (t) 


U(t) 


st = 


^ { T ^ F 2 (s+jnf^)D* (s+jnQ)e^^^^j ^l^®) 
and, since D*(s) is periodic in s with period 

G(s;t) = II I F 2 (s + jnfl)e^"“^|D*(s)F, (s) (6) 

V n=-“ ^ 

We note that, as a result of the sampling, the system function 
between continuous output and continuous input is periodic in 
time with a period equal to the sampling period. 


If the output y(t) is considered only at sampling instants, 
which amounts to introducing a "fictitious" sampler at the output 
as is done for instance in [2] or [14] , then a time-independent 
transfer function is obtained, viz. 


G(s;t) 


sample 

times 


— G ( s ) 


We shall consider G(s) defined 
function for the simulation. 


= F^* (s) D* (s)P^ (s) 

in (7) to be the 
Note that F 2 *(s) = 


fl 


(7) 

exact" transfer 
(VH^)*(s) . 


* The notation G(s;t) is used to emphasize the time varying 
nature of the system function. 
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Equation (7) is intractable for use with the continuous OCM. 
Therefore, it will be necessary to approximate (7) for closed- 
loop analysis. A straightforward approximation is to ignore all 
but the n=0 term in the expression for F 2 * which results in 
F2(s)D*(s)F, (s) 

In utilizing (8) it will be necessary to approximate D*(s); the 
procedure for doing this will be discussed in a subsequent 
section* . 


The approximation of Equation (8) will be good provided 
that the de-aliasing filter F^(s) is effective and that only 
the " low"-frequency range is of interest. Note, too, that 
this approximation can also be obtained by neglecting all but 
the first order terms in the exponentials in u^*(s) = Uj^(z) ^ 
this is clearly valid for "small" T. 


sT 


An alternative method of approximating G(s) is suggested 
by [2] . This method is based on introducing a fictitious sampler 
and hold following the continuous input (u(t) in Figure 4) and 
another fictitious sampler at the output. Then the Bode response 
between the envelopes of the sampled output and input is given by 


y* (s) 
u* (s) 


F2*(s)D*(s) (Fj^Fj^)*(s) = G*(s) 


(9) 


* Suffice to say, for now, that D*(s) will be approximated by 
a rational transfer function multiplied by a pure delay so 
as to yield a good match to the Bode response for D* (s) in 
the frequency range of interest. 



where F^(s) is the hold used to reconstruct the sampled u. Since 
the hold has been introduced to facilitate the analysis, the 
transfer function from u(s) to the envelope of y*(s) is then 
approximated by 


G(s) 


G*(s) 

Fh(s) 


G* (s)e'^h^ 


(10) 


where is the delay introduced by the hold. 


The last, and simplest, approximation we will consider is 
dictated by the response characteristics of the de-aliasing 
filters and data reconstruction elements that are of interest 
here. In particular, the transfer functions for the de-aliasing 
filter and servo are, respectively. 


oj^3 

^1^®^ "" s3 + 2oj s2 + 2w^"-s + w 
c c c 


v(s) = 


03 2 

n 


S^ +2 ^03 S+ 03 ^ 
n n 


( 11 ) 


( 12 ) 


The hold transfer function is either 

-sT 


Ho(s) = 


1-e 


or 


Hi(s)= T(l+Ts) 


1-e 


-Ts\ 2 


Ts 


(13) 

(14) 


For the simulation studies to be analyzed subsequently 
sample periods, T, of 1/32, 1/16, 1/10 will be considered. 
Therefore, if the cutoff of the de-aliasing filter is chosen 
on the basis of the sampling theorem, 03^ > 5Hz. The visual 
servo dynamics to be used are those of the visual system of the 
NASA LRC Differential Maneuvering Simulator (DMS) [15] . For 
that system, 03^ = 25 rad/sec and C = .707. 
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with the parameter values as just specified, each of the 
transfer functions of (11) - (14) may be approximated reason- 
ably well by a pure transport lag in the frequency region of 
interest for manual control (w< ~10 rad/sec). That is. 


where 


F^(s) 

~ 

e 


V(S) 



T.,S 


e 

V 

Ho(s) 

~ 

e- 

T S 
O 

T ^ S 

H^(s) 


e 

1 

T-rn 

2 


2t 

F 



7T 


V 


(?o)n) ^ = -057 sec 


To = T/2 


T, = T 


Substitution of (15) into (8) yields 


F^(s)D* (s)F 2 (s) = F^(s)D*(s)V(s) H(s) 

- D*(s) exp + T^)s 

where i = o or 1 for the zero-order or first-order hold, 
respectively . 


(15) 


(16) 


(17) 


The three approximations (8) , (9) and (17) are compared 
with the exact expression of (7) in Figure 5, for T = 1/10 
and H^(s) = H^(s). The D* in these figures corresponds to 
Euler integration of the F8 short period dynamics. In the 
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region w < 10 rad/sec all three approximations appear to be 
adequate. Equation (17) will, therefore, be used to model the 
effects of the A-D , hold and servo dynamics , inasmuch as this 
expression is both simple and cost-effective to employ in the 
continuous model. The cost-effectiveness arises from the fact 
that with Equation (17) no more states are required to model 
the open loop simulator dynamics than are needed for the con- 
tinuous problem being simulated; all that is changed is the 
time delay associated with the human operator. Although the 
results are not shown here, it was verified that including the 
exact transfers for the de-aliasing filter and visual servos in 
the closed loop analysis produces results that are virtually 
the same as those obtained with the time delay approximation. 

2.3 Effects of Discrete Integration 

In the previous section the transfer function D* (s) was 
left unspecified as was the manner in which it was to be approxi- 
mated for continuous closed-loop analysis with the OCM. In 
general, D* (s) will be a "distorted" version of the continuous 
system dynamics that are to be simulated. Some general features 
of the distortions introduced by various integration schemes are 
analyzed and presented in Appendix E. Here, we present results 
pertinent to the F-8 dynamics that are to be analyzed later. 
Specifically, after a brief discussion of the basic effects of 
discrete simulation, we show how two integration schemes that 
are of particular interest for real-time simulation, Euler and 
Adams-Bashforth (A-B) , effect the open- loop F-8 dynamics. We 
then develop suitable approximations for D*(s) to be used in the 
closed- loop analysis. 
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2.3.1 Basic Considerations 


Consider the continuous vehicle-dynamics as described in 
the state-variable form of Equation (1) . For constant system 
matrices, the transfer matrix between system outputs and control 
inputs is given by 


y{s) = ^^(s) u(s) 

(s) = C (sI-A ) 
-c -c ' - -c 


B 


-c 


+ D 
-c 


(18) 


When Equations (1) are "integrated" digitally, they lead 
to a discrete approximation with the following transfer matrix 
[see Appendix B] 


D*(s) = {c^[zI-A^] 


-1 




z=e 


s T 


(19) 


where the matrices in (19) depend on the particular integration 
scheme and sample period as well as on the corresponding contin- 
uous system matrices. Several points concerning Equation (19) 
are noteworthy. First, the elements of the discrete transfer 
matrix, D*(s), cannot, in general, be expressed as the ratio 
of two polynomials in s of finite degree. Second, the Bode 
responses corresponding to (19) will differ from the continuous 
responses in both amplitude and phase; and, further, the responses 
for the discrete system are periodic in to with period equal to 

2 TT 

— rp- Third, the poles and zeros of Equation (19) are infinite 
in number and are given by, for example. 


P . 

1 


(7^ + j ( tOj^ + 2 Tfk) ; k — 0, +1, +2,..« 


( 20 ) 
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Moreover, the principal values for the poles and zeros, i.e., 
those with k = 0, are not, in general, equal to the correspond- 
ing poles and zeros of the continuous system. Finally, simple 
integration schemes, such as Euler, will have the same number of 
principal poles as the continuous system, whereas multi-step 
integration schemes, like A-B , will introduce principal roots 

that are spurious. 

2,3.2 Eff ects on Open-Loop F-8 Dynamics 

The longitudinal and lateral dynamics for the F8 aircraft 
that are to be the subject of the closed loop analysis are given 
in state variable format in Appendix C. The dynamics correspond 
to a single flight condition, but involve both CAS-ON [16] and 
CAS-OFF modes. In addition, a simplified set of lateral dynamics 
corresponding to perfect coordination is included. 

Charaotevist-io Modes 

The effect of integration scheme and sample period on the 
characteristic modes of the F8 are shown in Tables 1 and 2 . 

Table 1 is of prime interest here in that it shows how the basic 
modes are "perturbed" by the discrete simulation; Table 2 lists 
the "spurious" modes of lowest frequency introduced by A-B 
integration . 

It can be seen from Table 1, that Euler integration has the 
greater effect on the location of the characteristic modes. In 
terms of the basic, unaugmented dynamics its main effect is a 
reduction in the magnitude of the real parts of the character- 
istic roots. Thus, the damping ratios for the longitudinal 
short-period mode and for the lateral dutch roll mode are reduced. 
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and may reflect numerical error. 




For the lowest sampling rate, T = .1 sec, the reduction in 
damping is quite significant. The effect on the natural fre- 
quencies of these modes is minor, with frequency increasing with 
decreasing T. The reduction in damping will result in a simu- 
lated aircraft with short period and dutch-roll handling charac- 
teristics that are poorer than those of the "true" aircraft. 

On the other hand, the reduction in magnitude of the real parts 
of the characteristic roots leads to an improved roll response. 

In particular, the time constant of the roll subsidence mode is 
reduced by Euler integration, thus yielding quicker roll response 
For T = .1, the time constant is reduced. from .388s to .336s, 
i.e., by almost 15%. The effect of Euler integration on the 
spiral mode is negligible. 

The effect of A-B integration on the aircraft modes is both 
smaller and in a different direction. Damping ratios for the 
short period and dutch-roll modes are increased by A-B integra- 
tion, although by amounts so small as to probably be negligible. 
The changes in the natural frequencies of these modes are similar 
to that observed for Euler integration. The roll-response is 
degraded slightly in the A-B case and the spiral mode is appar- 
ently unaffected by the integration scheme. 

The CAS-on configurations show some of the same trends as 
those above. In particular, the effects on damping ratios and 
time constants are qualitatively the same as for the CAS-off 
configuration. However, the pitch CAS-mode natural frequency* 
is affected to a much larger extent than is the frequency of the 
short period mode. Euler integration tends to increase the fre- 
quency of this mode as before. On the other hand, for A-B integr 
tion the CAS-mode natural frequency decreases with sample period, 
a trend that is opposite to that for the other modes. 


* The pitch CAS is a C*-model following design and is described 
in Section 4.1. 
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As we have seen, the effects of A-B integration on the 
aircraft and CAS modes is generally less than that for Euler 
integration, but A-B introduces spurious roots. The frequency 
and damping for the unwanted roots with lowest frequencies are 
given in Table 2 , It can be seen that the spurious roots are 
outside the frequency range of interest for closed-loop manual 
control and, for sample periods as low as .03125, are unlikely 
to present any problems. However, for the higher sample per- 
iods considered, the roots could lead to undesirable or incor- 
rect open- loop responses (e.g., responses to step inputs). In 
general, the spurious roots could result in an interaction with 
CAS modes and structural modes (if included) that would be 
absent in a continuous simulation or in a discrete simulation 
with a simpler integration scheme. We will not consider this 
issue further in this report but mention it as a factor when 
considering multi-step integration schemes for simulation. 

Bode Responses 

The above analysis ignores zeros and, generally, does not 
give the full picture with respect to the distortions introduced 
by digital integration. Indeed, from a closed-loop standpoint, 
the most important effects of discrete integration are likely 
to arise from phase distortion (lag) rather than from perturba- 
tion of the characteristic modes. To get a better appreciation 
of the overall effects of discrete integration, and as a prelude 
to approximating D*(s), selected Bode responses for the F8 dy- 
namics are presented in Figures 6-9 . Additional Bode responses 
for the cases of interest is given in Appendix B. 

Figure 6 shows the effect of Euler and A-B integration on 
the pitch/elevator (0/6e) transfer function for the F8 unaugmented 
short period dynamics. The continuous transfer function, the 
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TABLE 2 


LOWEST FREQUENCY SPURIOUS MODES 
FOR ADAMS -BAS HFORTH INTEGRATION 



— 

1/32 

1/16 

1/10 


C 

“n (rad/s) 


^n (rad/s) 

C 

^n (rad/s) 

Longitudinal 







CAS OFF; 

.88 

121. 

.83 

49.9 

.79 

26.7 

CAS ON: 

. 60 

105. 

. 38 

44.4 

.15 

25.8 


.81 

121. 

.74 

50.6 

.65 

27.3 

Lateral 







CAS OFF: 

. 89 

114 . 

. 85 

46.6 

. 81 

24 . 5 


. 72 

144. 

. 62 

63.7 

. 52 

36.7 

CAS ON: 

. 82 

120. 

.74 

50 . 0 

.66 

26.9 


.60 

126. 

. 44 

56.1 

.29 

32.8 

Coordinated 








.70 

142 . 

.60 

62 . 9 

^50 

36.2 

- J 








corresponding discrete transfer function and a curve of the 
distortion introduced by the discrete integration are all pre- 
sented. Distortion is defined as the ratio of the discrete 
Bode response to the continuous response. Thus, in terms of 
amplitude and phase, it is the difference between the two 
responses, where amplitude is given in dB . Curves are given 
for the highest (T = .1) and lowest (T = .03125) integration 
step of interest. (It has been assumed that the integration 
step size is equal to the sample period.) Figures 7-9 contain 
similar plots for the roll angle/aileron (({)/6^) for the lateral 
CAS/ON configuration and for the and transverse line-of- 

sight tracking error/aileron (Re^/^^) transfers for the "coor- 
dinated" lateral dynamics. 
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Figure 6 .- Pitch/Elevator (9/6^) Bode Responses. 




h) e/«e, A-B, 

T=. 03125. 
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Figure 7. - Roll/Aileron Bode Responses, Lateral CAS-ON Dynamics, 
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The following observations may be made from these responses 
and those in Appendix B. 

(i) For T = .1, both integration schemes evidence the 

expected periodic behavior with the responses 

2 7T 

repeating at intervals of = 62.8 rad/sec. The 

• .L 

lower sampling periods repeat beyond the range of 
frequencies that are plotted. This sampling effect 
is outside the frequency range of interest for 
closed-loop manual control (say cjo < 10-12 rad/sec 
for the tasks considered here) . 

(ii) As expected, both integration schemes show decreases 
in distortion with decreases in sample period. 

(iii) In the frequency range of interest, the amplitude 

distortion for Euler integration is greatest in the 
region of the oscillatory characteristic mode as a 
result of the reduction in damping discussed in the 
previous section. On the other hand, A-B integra- 
tion tends to show significant amplitude distortion 
at frequencies greater than the characteristic fre- 
quencies, at least for T = .1. This distortion 
introduced by A-B integration will be discussed later. 

(iv) The phase distortion for both schemes corresponds to 
increased phase lag at almost all frequencies. For 
Euler integration, the added phase lag is undoubtedly 
the dominant "error" introduced by discrete integra- 
tion. For A-B integration the additional phase lag 
is almost negligible in the range of interest, but 
there is substantial lag at higher frequencies. 
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(v) For longitudinal control, both outputs that drive 

the visual servos, pitch angle and LOS vertical error, 
have the same additional phase lag as a result of 
the discrete integration. This is true for both 
CAS-OFF and CAS-ON modes . For Euler integration 
of the CAS-OFF configuration the additional phase 
lag corresponds to a transport lag, or time delay, 

of ~T seconds; for the CAS-ON configuration the 

. 3T 

additional delay is ^ seconds. 

(vi) For lateral control the two outputs driving the 

visual servos, bank angle and transverse LOS error, 
are also delayed by the same amount whether the 
CAS-OFF or CAS-ON dynamics are considered. However, 
unlike the longitudinal control case, the effective 
delays for Euler integration are the same for both 
CAS-ON and CAS-OFF, viz., ~T seconds. For Euler 
integration of the "coordinated" dynamics, the cj)/<S 
transfer has an added delay of about T seconds, 

but the additional delay for the Rern/^ transfer is 

3T ^ 

about — 2 seconds . 

2.3.3 C ontinuous Approximations of Discrete Bode Responses 

We are now in a position to complete the continuous approxi- 
mation to the open-loop simulator dynamics by deriving suitable 
approximations to D*(s) for the various conditions of interest. 
Because of the restrictions imposed by the OCM, we restrict the 
possible approximations to the following form: 


u . 
3 


D* . . (s) 
13 


D^j(s)e 


( 21 ) 
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where D(s)is a ratio of finite polynomials in s with numerator 
degree less than or equal to the degree of the denominator. 

Note that the same "computation" delay, is associated with 
each transfer function. This was seen to be a good approxima- 
tion for all sets of dynamics considered here but the coordinated 
dynamics. The discrepancy in delays for coordinated dynamics 
will be accounted for by adding a first-order, rational Fade 
approximation to the Re^/6 transfer for this case. The values 
for for the various dynamics and the two integration schemes 
are given in Table 3.* 

The general problem of determining a D(s) that best approxi- 

T S 

mates D*(s)e ^ over some frequency range (say, 0 < 03 < 12 rad/sec) 
is a variant of the identification problems examined in 
control theory (see, e.g. , [17]). A variety of sophisticated 

algorithms have been developed to attack the problem but no 
general solution exists. The application of such algorithms to 
the determination of D was beyond the scope of this effort so 
simpler, more intuitive, schemes were employed. 

The simplest approach to selecting D is to use (18) and 

let 

D (s) = (s) (22) 

13 Cij 

From the standpoint of the OCM, this means that the state equa- 
tions for the original dynamics are used and discrete integration 
is modeled by adding a delay determined from the phase distortion. 
As we have stated earlier, such an approximation probably accounts 
for the major source of difficulty in discrete integration. How- 
ever, to employ it exclusively is to leave us somewhat uncertain 
as to the closed-loop significance of the amplitude distortions. 

* The delays for A-B integration are large to offset lead intro- 
duced by an added zero to account for amplitude distortion 
(see below) . 
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TABLE 3 

APPROXIMATE INTEGRATION DELAYS FOR CONTINUOUS MODELING 



* The effective delay for Adams -Bashf or th in the bandwidth for manual control 
is virtually negligible. 

** Zero-Modeling of A-B integration was not performed for Lateral Dynamics 


oi 


Approximations were found that better accounted for the 
amplitude distortions in simulating the longitudinal control 
task and the lateral control task with coordinated dynamics. 

For Euler integration, this was accomplished by finding values 
for the aircraft stability derivatives that gave characteristic 
modes approximately equal to the principal roots obtained from 
the discrete integration of the original dynamics.* Table 4 
shows the changes in stability derivatives necessary to match 
the roots of the discrete system. Figure 10 compares the result- 
ing approximate continuous transfer functions with the discrete 
Bode responses for Euler integration of the longitudinal CAS-OFF 
dynamics. It can be seen by comparing these results with those 
of Figure 6 that this approximation is closer to the correspond- 
ing discrete Bode response than is the original continuous 
transfer. This is also true for the approximation to the pitch 
CAS-ON dynamics as is seen in Figure 11, although the absolute 
agreement between approximate CAS-ON dynamics and discrete Bode 
response is not as good as for the unaugmented case. 

The strategy for approximating A-B integration was some- 
what different. Values for stability derivatives were adjusted 
to match the characteristic modes as in the case of Euler inte- 
gration. However, the major source of amplitude distortion in 
A-B integration is not the result of the relatively minor pole 
perturbations introduced by this scheme. Rather, the amplitude 


* In the case of the longitudinal CAS-ON dynamics, both stability 
derivatives and CAS parameters were changed to obtain the 
requisite approximation. 
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Integration 

Scheme 

Sample Period 
Longitudinal 

Mq 

Ma 


Coordinated 

L 

P 

^6 


TABLE 4 


STABILITY DERIVATIVE CHANGES 
TO MATCH DISCRETE ROOTS 



Euler 

\ 

Adams-Bashforth j 

Continuous i 

1/32 

1/16 

1/10 

1/32 

1/16 

1/10 

-.487 

-.346 

-.194 i 

0 

-.494 

-.516 

-.562 

-4.79 

-5.00 

-5.22 

-5.43 

-4.79 

-4.86 

-4.96 

00 

in 

CN 

1 

-2.69 

-2.82 

-2.98 

-2.58 

-2.56 

-2.51 

17.24 

17.95 

18.83 

19.91 

17.24 

17.07 

16.74 




















Figure 10 Continuous Approximation to Discrete, CAS-OFF Pitch/ 
Elevator Bode Response (Euler integration, T=.l), 
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Figure 11. -Continuous Approximation to Discrete CAS-ON Pitch/ 
Elevator Bode Response (Euler Integration, T=.l). 
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distortion for A-B is characterized by the amplitude ratio not 
"rolling off" as rapidly as the continuous amplitude ratio in the 
mid- to high-frequency region (the actual frequency range depends 
on the sample period) . This effect can be modeled by introducing 
an appropriately located zero in the transfer function. However, 
the introduction of such a zero will add phase lead that must be 
cancelled by adding transport lag. 

Figure 12 shows the approximation to the A-B 6/6 , CAS/OFF 
Bode response for T = .1. The approximate transfer function 
was generated by introducing a zero at w ^ 6.5 rad/sec, setting 
= .14 seconds and perturbing the pitch damping and static 
stability derivatives as indicated in Table 4. Similar agree- 
ment was obtained for the longitudinal CAS/ON and coordinated 
A-B Bode responses and for different values of T. For the 
smaller values of T, the frequency of the zero increases (to 
~ 22 rad/sec for T = .03125) and the amount of delay that must 
be added is consequently reduced. The effective delays for the 
A-B approximation with the zero added are given in Table 3. 


The nature of the approximation for A-B integration may 
be understood better by comparing the z-transform for a "discrete 
A-B integrator" to that for the Euler integrator. These are 
given by (see Appendix B) 


A-B: 


1 ^ T (3z-l) 
s 2 z (z-1) 


1 T 

EULER: J -> -V 
s z-1 


(23) 
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PHASE (DEGREES) 



When compared with Euler integration, A-B has an additional 
pole and zero in the z-plane. The lead introduced by the zero 
apparently more than compensates for any lag introduced by the 
added pole, thereby giving the overall desirable phase charac- 
teristic for A-B integration. However, for the continuous model- 
ing being attempted here, if the amplitude distortion is to be 
accounted for by adding a zero to the continuous transfer func- 
tion, then the additional delay implied by the second order 
denominator must also be included. 


82 



2.4 Summary 


In the previous sections the open-loop dynamics for a fixed- 
base simulation were considered. Continuous approximations to 
these dynamics were developed for use in the closed— loop analysis. 
The basic result was that for the frequency range likely to be 
of interest in continuous aircraft control problems, the simulator 
transfer function could be modeled as 


y (s) 
u (s) 


D(s)e 


(24) 


where D(s) is an "approximation" to the Bode response for digital 
integration of the vehicle dynamics (denoted by D*(s)). The 
simulator delay, t^, is given by 


T 


S 


+ 


H 


+ 


T + 
V 


T 

C 


(25) 


where t^, t^, and respectively, are the delays introduced 
by the de-aliasing filter, hold, visual servo and CPU (discrete 
integration) . 


It was found that very good approximations to discrete Bode 
responses could be obtained for the longitudinal control tasks 
and for the coordinated lateral control task to be analyzed later. 
These approximations involved perturbation of aircraft stability 
derivatives and CAS parameters to yield continuous modes that 
agreed with the discrete modes and, in the case of A-B integra- 
tion, the introduction of a zero in the continuous vehicle trans- 
fer. Similar approximations for the full lateral dynamics, 

CAS-ON or CAS - OFF , were not obtained. It is anticipated, however, 
that by incorporating the phase lags introduced by discrete 
integration, the dominant effects on closed- loop performance 
and workload would be accounted for in these cases as well. 
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The approximation of Equation (24) readily lends itself 
to efficient application of the OCM. The system matrices 
corresponding to a state representation of D (Equation 1) and 
the values for are easily obtained for different sample 
periods, etc. For each condition, a single run of the OCM is 
sufficient to predict the corresponding performance. Adjust- 
ment of pilot parameters, specifically observation noise 
levels [18], allows the sensitivity to pilot attention to 
be examined. 

There are shortcomings in the continuous model . For 
example, the effects of aliasing are not considered. Thus, 
the degrading effects of the de-aliasing filter are included 
in the continuous model but not its benefits. This means 
that decreasing the bandwidth, of that filter can only 

lead to negative results, a situation that is not obviously 
true, in general. Similarly, because only the delays inherent 
in the data holds are considered, zero-order holds will always 
show less degradation than first-order holds. But, in some 
instances, the first-order hold may provide advantages that 
outweigh the additional delay penalty. This type of trade- 
off cannot be explored with the continuous OCM. Because of 
these and other potential shortcomings, it was decided to 
develop a hybrid model. This model is discussed in the next 
chapter , 
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3. THE HYBRID MODEL FOR ANALYSIS OF CLOSED-LOOP SIMULATORS 

The development of a hybrid model was motivated by two 
considerations: 1.) the desire to verify the results obtained 

with the continuous model; and 2.) the need to investigate issues 
not readily addressed by the continuous model. One approach to 
developing such a model is to derive analytic expressions for all 
the variables in the closed-loop following, e.g., the techniques 
in Appendix A that were used to develop exact transfers for the 
open- loop simulator dynamics. This approach was explored briefly 
but was abandoned because it would have required major computer 
program development even if it had been successful. Instead, the 
approach taken was to "simulate" the simulation. This involved 
modifying an existing program for a discrete simulation version 
of the OCM [19] as discussed below. 

3.1 Simulation Version of OCM 

To understand the nature of the hybrid model it is necessary 
to review the discrete simulation model of the OCM as described 
in [20]. The major relevant aspects of the model and some of 
the modeling issues are discussed below. 

3.1.1 $y s tern- Pi s p1 ay Dynamics 

There are no modeling restrictions on the system being 
controlled, other than that a set of displayed elements y(t) at 
a time t be generated from: 
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u(t) = human's control inputs 


w(t) = zero mean, white Gaussian random input 
disturbances or commands* 


For the special case of a linear system, the system equations 
are (as in Equation [1] ) 


x(t) = A ^(t) + B u(t) + E w(t) 

" S S “ s 

y(t) = CgX(t) + DgU(t) 


(26) 


where x(t) is the system state vector. The system parameters 
(Ag, etc.) may be time varying. 

3.1.2 H uman Operator Internal Model 


In the OCM, the human is assumed to have an internal charac- 
terization of the input-output response of the system. This 
"internal model" is assumed to be linear, in state variable form. 


X (t) = A X (t) + B u (t) + E w (t) 

-m ' -m-m ‘ -m-m ' — m-m ’ 


y (y) = C X (t) + D u (t) 

— m ^ — Tn tti — tti — m ' 


-m m 


m-m 


where 


(27) 


x_(t) = internal model states 
-m 

w (t) = model Gaussian white noise inputs 
-m 


etc . 


* Actually, deterministic inputs are also allowed but are not 
relevant here. 
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The states of the "internal model" need not be the same as those 
of the system. Indeed, it is not even required that dimension 
{Xj^} = dimension {Xg}. Similarly, internal representation of 
disturbances can differ from system disturbances. On the other 
hand, the model inputs and displayed outputs yj^(t) are 

assumed to be the same as the actual system inputs u(t) and dis- 
plays ;^(t) to avoid numerous conceptual problems, i.e., 

u^(t) = u(t) 

Xm<t) = y(t) 

The internal model parameters (A^^, etc.) can also be time-varying. 

The choice of an internal model is somewhat subjective. 

When the system is continuous and the operator is well- trained, 
a very reasonable and convenient choice is A = A , etc . J i.e., 
the internal model is the same as the system. This, of course, 
is the choice employed in the standard OCM. However, when the 
"system" is a simulation of a continuous system, the choice of 
an internal model is less obvious. Because of its generality, 
the hybrid model will allow us to examine alternative choices. 

The internal model is used within the OCM to help generate 
a (continuous time) human operator control input via: 

u(t) = -L^ 


u (t) 




( 28 ) 
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The feedback gains 

he = In"^] = [Lcll Lc2] (29) 

are generated via auxiliary programs that solve the optimal con- 
trol problem for the model equations. The model is also needed 
in the construction of the Kalman filter-predictor that generates 

the model state estimate x (t) . 

-m 


3.1.3 Human Limitations 


ys. 

The human generates Xjj^(t) on the basis of the delayed and 
noisy perceived information: 

y .(t) =N.[y.(t-x)] +v .(t) i=l,...,NY (30) 

pi 11 yi 


where 


T = the human's time delay. 


v^(t) = the observation noise at time t, 

and N. (.) is the non-linear observation theshold: 
1 


x-a . 
1 


X > a 


(x) - < 


xj< a^ 


x+a . 
1 


X < -a. 


(31) 


In a simulation model, it is possible to implement the non-linear 
observations using Equations (30) and (31) . However, in a human 
operator context we find it more meaningful and convenient to 
replace ( . ) by an equivalent gain, N^. The random imput des- 
cribing function; 
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I 


y\ 



erfc 


bsL 


a±/2^ 


(32) 


is used. is interpreted as the probability that the human 

will respond to given its present value at time t. 


Each observation noise v . (t) is a zero-mean, white Gaussian 

yi 

noise with covariance: 


V° . (t) 

ElVyi(t) Vy^(a)] = — 6(t-a) 


(33) 


that contains both an additive and a ratioed component 


V°.(t) = V . (t) + Tip .E[y.2(t-t] (34) 

yi yi yi ^ i 

The quantity > 0 is the attentional allocation to the displayed 
variable y^. The are constrained by: 

NY 

J (t) = = constant total attention (35a) 

i=l 

fi^l(t) = f^(t) i-1,3, . . . ,NY-1 (35b) 

to indicate that position-velocity pairs are obtained simultan- 
eously from the display elements, a standard OCM assumption [5] . 


The neuro-motor interface portion of the model is given by 
Equation (28). The motor noises (t) are zero-mean white 
Gaussian noises, with covariance: 


E[v . (t) V .(a)] = v° . (t) 6 (t-a) 

ui ui ui 


(36) 


that contains an additive and a ratioed component. 


V° . (t) s V . (t) +TTp . Elu. (t) ] 
ui ui ^ur 1 


(37) 
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3.2 Discretized Equations for Hybrid Model 


The hybrid model employs the simulation version of the OCM 
in a closed-loop digital Monte Carlo type computation in which 
"continuous” elements of the loop are updated at a rate signifi- 
cantly greater than discrete elements. In other words, the 
hybird model is a multi-rate sampling system, rather than a true 
hybrid system. (Informal experimentation indicates that a sample 
rate five times that of the discrete elements is adequate to 
simulate continuity for the cases considered here.) In addition, 
to different sample rates for continuous and discrete elements, 
the updating of the discrete equations of the hybrid model is 
different for the two kinds of elements. In particular, discrete 
elements are updated by means of the integration scheme and time- 
step specified for the simulation. The equations for continuous 
elements are updated at the faster rate via the transition matrix 
method of integration described in Appendix B. Below, we proceed 
around the closed-loop, starting with the digital computer, and 
give the basic equations for the hybrid model. 

3.2.1 Vehicle Dynamics 

The digital computer integrates Equations (26) using the 
sampled value of the output of the de-aliasing filter. Given a 
simulator time step T, the system equations generate outputs 
y^ (k) = y^(kr) ~ y(t) from the piecewise-constan t inputs u(k-l) 
and w(k-l) via 

x(k+l) == A^x(k) + B^u(k) + TE^w(k) 

ylk) = C^x(k) + D^u(k-l) 

where A^, etc. depend on the integration scheme and are defined 
for various methods in Appendix B. 
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3.2.2 D-A Interface 


The D-A interface consists of the data hold plus visual 
servo. Consider first the zero-order hold. The sampled output, 
is held constant over a sample period. The constant value 
is the input to the visual servo. It is assumed that the operator 
observes both the servo output and its rate yi^^* The trans- 

fer function for the visual servo is given by Equation (12). 


A convenient state space model for the servo is 


n 1 



— 


— 



^id 

_ 

0 

1 


yid 

+ 

0 

yid 





yid_ 


-CO . ^ 

1 


or, with 

^1 = tyid ' 

we have 


X . 
— 1 




V^ 


(38) 


(39) 


(40) 


This is simulated in the hybrid model in a subroutine called 
DAC via transition matrix integration of (38), i.e., 

x^(kT+ilA) = e-'^'^x^ [kT+ (il-1) A] + /e-^^b^da ,y^ (kT) (41) 


where A 
and 


is the time step for the faster (continuous) sample rate 


1 = 1 , . . . , = T/A 


(42) 
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Thus, the servo outputs are updated times over a system simu- 
lation interval T. For that simulation interval, in the case of 
a zero order hold, the input is constant. 


When the data hold is a first order hold the situation is 
a bit more complex. Over a simulation sample period T, y^(t) is 
defined by 


y. (t) = y. (k) + M,t, kT<t<(k+l)T (43) 

1 1 K -I- — 

where 

T 

To get state-equations for the servo with the input coming from 
a first order hold, we let 


Then 


s" = [ydi ydi yii 


X = A X + b 


with 



- ^ 

- 


_Ay_ 

bv 

A = 


— 


0 

0 



J 


^0 


/ ^ = 


(44) 


(45) 


Equation (44) will be integrated digitally, at the fast sample 
rate, so yj^(t) must be approximated by a piecewise constant func- 
tion. We do this by using average value of y^^(t) over the 
interval (£+l)A]. Let be defined to be this average 
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value. 


Clearly , 


with 

= Y ( k) + § 

Combining the above yields 

?»il = yAk) + (A+1/2) (45) 

x,+x 1 ^ 

where we have used T = N^A.* 


Now, the same transition matrix update is used as before, 
but the input is changed each A. Thus, with x defined as in 
(39) 

x[kT+(Jl+l)A] = e x[kT+HA] + fi , 

i = 0, 1, . . . (46) 


3.2.3 Human Operator Model 


The OCM internal model Equation must be updated every A 
seconds. This is done by the transition matrix method, so 


x^(kT+£A) - ij^x^[kT+(^,-l) A]+r^u[kT+(S,-l)A]+AEj^Wj^ 
y(kT+ilA) = C^x^[kT+5,A] + D^u [kT+ ( il-1) A] 


(47) 


* It is interesting to note that 
and the subsequent integration 


for = 1 
is similar 


r = 3y (k) -y (k-1) 
^o 2 

to A-'B integration. 
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where 


$ = 
-m 


A A 
-m 


A 


r 

-m 




B da 
-m 


( 48 ) 


The human operator model generates a control input u(jl) , to 
use over the time interval (t, t+A) , via 

+ L_v (£) (49) 

2 u 

where t = kT + £A and we have suppressed the A's in function 
arguments for convenience. Note that it is the control input 
itself that is considered to be piecewise constant for inter- 
face with the simulator model. This is in contrast to the 
covariance propagation approach corresponding to the standard 
OCM where control-rate is assumed piecewise constant with: 


u(il) - u(£-l) = -L ^ 


X (^) 
m 

u(^-l) 


u(£) = -L^ 


x(£) 

u (£) 

» — 




(50) 


The gains L = [L^|L 2 ] in Equation (49) are the discrete equiva- 
lents of the continuous gains of the standard OCM and are computed 
as described in [19]. 


The discretized observations for the human operator model 

are : 


y . (£) = N. y,. (£-N) + v . (£) 
■^pi 1 di yi 


(51) 
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where, if t = human's time delay, N = integer [t/A] . The 
covariance of the piecewise-constant white noise is 

[Vyj^ (£,) /f^ (il) ] to account for the finite time step. Simi- 
larly, the covariance of the motor noise v (£) now becomes 

r\ ^ 


The observation and motor-noise covariances are defined 
by Equations (33) -(37). These equations require process 
(i.e., ensemble) statistics at time ilA . However, these are 
not available from a single Monte-Carlo trajectory, and their 
precomputation for subsequent read-in is unfeasible- The 
approach we have taken is to obtain temporal approximations 
using filtered past data. An approximation 

cc (k) = E [y^^ (K-N) ] 

2 

is obtained via Ist-order filtering of y^ (k-N) , 

a(k) = e"^'^'^ma(k-l) + ( l-e“^/^^) y^^ ( k-N) (52) 

with initial condition a(N-l) = y.^(O) . The approximate variance 

2 • . ^ 

of u^ (k-1) is found using a two-step procedure that estimates 
(through filtering) the mean and mean-square, and then computes 
the variance. The time constant t =0.5 sec. 


The OCM includes a Kalman estimator and an optimal predictor. 
The estimator processes yp^ to generate an a posteriori estimate 
of the delayed state 


§(£/£) 


E{x (£-N) 


iTp(O) 


(kT+^) } 
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according to well-known equations [19] . The predictor forms an 
estimate x(£) from p(£/£) using 

N+P-1 

/s 'Nr+p ^ ^ n -i 1 

x(il) = o(il/£) + y r-^ u (£-i-l) (54) 

' -m -m -c 

where u is the deterministic part of u. In the standard OCM, 
c 

PEO and the prediction compensates for the human's delay. Here, 
we let P be a positive parameter to be selected so as to yield 
the best performance, the idea being the human operator will 
have to compensate for simulation delays as well as his own. 

3.2.4 A-D Interface 


This interface consists of the de-aliasing filter, a samp- 
ler and an implicit hold corresponding to the piecewise constant 
input assumption associated with integration in the digital com- 
puter. The filter considered here is a third-order Butterworth 
filter which can be represented in state space form as 


-F 


0 10 


0 

2 2 
-w -2^03 00 

+ 

0 

c ^ c c 

-F 

0 0 -00 ^ 


2 

00 

c 


c 


u 


(t) 


(55) 


Ap + b„ u, (t) 


(56) 


Equation (56) is integrated using the transition matrix 
method and a time step of A. However, only the values of the 
filter output at the simulation sample times, u^^ (kT) (k=0, 1, 
. . . ) , are used by the computer in subsequent updating of the 
vehicle dynamics. 


For the third order Butterworth C = ^nd the value of 

is nominally set to half the sampling frequency, but different 
values can be tried within the context of the hybrid model. 
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3.3 Steady-State Solutions 

The hybrid model of the closed loop simulation is a Monte 
Carlo model that normally will require many solutions to obtain 
meaningful statistics. In the analyses to be performed in 
this study we are interested in the steady-state response of 
stationary systems. Rather than average over many Monte Carlo 
solutions, we have assumed ergodicity of the processes and 
utilized time-averaging of a single response. 

Two questions arise in attempting to determine steady- 
state statistics via time-averaging; 1) when should the 
averaging process begin? and 2) what length averaging "window" 
is necessary? Of course, if one averages long enough the two 
questions become moot, but very long averaging times can be 
as expensive as ensemble averaging. Given the practical con- 
straints on run-time, we want to be sure that steady-state 
statistics are not biased by initial transient responses and 
that averaging windows are sufficient to provide enough inde- 
pendent samples, given the correlation times of the processes. 

The rationale for the choice of the "transient window" 
to be discarded and the "averaging window" to be selected in 
the Monte Carlo model is as follows . Let M^ be the estimate 
of the mean of the process obtained by averaging over the 
first samples y(i) , i = 1, of output from a Monte-Carlo 
simulation. That is, 

Ni 

M = i I 
1 
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Let be the estimate of the variance, defined by 



Let M^, N2 be defined in a similar fashion. We shall 

treat the first samples as the transient window to be 
discarded and the samples from to N2 as the averaging 
window. Let M^2 ^12 estimates of mean and variance, 

respectively, over the averaging window ^ defined by 


M 


12 


N2-N1 i=N^+l 


No 

I y(i) 


V 


12 


= {kFP 


N 2 

y y^ (i) 


- M 


12 


It is easy to show that 


V 


12 


N2-N1 


+ N2m2-N^m2 
^ 2-^1 


(N2M2-N1M1) 


If we assume = M2 (which is reasonable because, ideally, 
the process mean is zero) then 


V 


12 


N2V2-N1V 
N2-N 


This formula for V^2 used on a representative Monte Carlo 

run of sufficiently long duration to check how V^2 ^^r various 
and N2 compares with the estimate of variance obtained by 
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averaging over the entire run. A transient window width of 
3000 samples and an averaging window width of 7500 samples was 
found to give satisfactory results. 


Consider now the confidence that can be attached to the 
results obtained by the above averaging process. Assuming 
y(i) is a zero mean uncorrelated sequence with variance 
(in steady state this is what we expect) , 

I N2 1 

E (I .J - ^ 12 ] = 

where N = and 


Var 



E 




2 


By Chebyshev's inequality, 


P 



E(Vi2) 



2a' 


N( . 05a^) ^ 


800 

N 


Thus, N = 7500, guarantees that V ^2 will differ by less than 
5 % from the true a^ with probability roughly 90%. 


* When y. ~ N(0,a^) the fourth 


moment E (y . 

^ 1 


) = 3a 
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4. 


APPLICATION OF SIMULATION MODELS 


In this chapter the models for closed-loop simulation are 
applied to an "example" simulation involving air-to-air target 
tracking. Results are obtained to demonstrate the effects of 
various simulation choices as well as problem-dependent effects. 

Experiments are planned to test the validity of model pre- 
dictions in the above example. Here, as a preliminary demon- 
stration and validation of the modeling approach to analyzing 
simulation requirements, a comparison of model results with 
data obtained from an independent investigation into the effects 
of computation delays [20] is presented. 

4.1 A Target Tracking Problem 

The model of the closed loop simulation will be applied 
to an example to explore and analyze basic simulation effects 
and to (eventually) test the model's validity. The example is 
reasonably realistic, involving the longitudinal and roll-axis 
lateral dynamics of a high performance (F8) aircraft. Longi- 
tudinal and lateral tracking will be considered separately. 
Air-to-air target tracking is the pilot's task. 

Below we define the tracking geometry, target motions, 
and the attacker aircraft dynamics for each tracking task. 

The state-variable descriptions of the system dynamics (target 
plus aircraft) as required for application of the models are 
given in Appendix C. 
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4.1.1 L ongitudinal Tracking 


The longitudinal tracking task to be considered is similar 
to that studied in [20]/ but differs in the definition of track- 
ing error and target input. The equations for this task will be 
developed in an attacker-centered coordinate system with the 
effects of gravity neglected. 

a . Geometry 

Figure 13a shows the geometry of the air-to-air tracking in 
the longitudinal plane. The gunsight is assumed to be fixed and 
aligned with the aircraft body axis. For longitudinal tracking 
we will assime that no information concerning the target's pitch 
angle (or the relative aspect angle) is available. If we assume 
that the target velocity (V^) and attacker velocity are nearly 
equal (V^ ~ V) , then, for small (relative) angles 

• V V • * • * 

^T^ "" R ^"^T ” "Y) = R " h) = 0 + 


or 


R = V(h^-h) - R 0 (57) 

where R is the target's range and is assumed constant and equal 
to 182.9m (600 ft.) , as in [20] . 
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a) LONGITUDINAL (ELEVATION) 



Yt = INERTIAL LINE-OF-SIGHT ANGLE (ELEVATION) 
R = TARGET RANGE 

«v= elevation tracking ERR0R = 2j 



St = inertial line-of-sight angle (transverse) 
't 

€y = transverse tracking error = 2t^-V' 

= TARGET LATERAL FLIGHT PATH 


Figure 13. - Target Geometry. 



b. Target Motion 


The target will be assumed to execute random vertical 
evasive maneuvers.* In particular, target altitude variations 
will be generated by passing white, zero mean, gaussian noise 
through a third order filter as illustrated below. 


w 

1 


1 



s+1 


S^+^2 03^ S + 03^ 

/ 


(58) 


By selecting the covariance of the white noise and the cutoff 
frequency of the Butterworth filter, rms altitude variations 
and normal accelerations may be specified. Two motion variations 
will be considered in the longitudinal analysis as indicated 
below. 



* We wish to avoid the simple sine-wave tracking task of [20] . 
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c. 


Aircraft Dynamics 


The longitudinal short-period dynamics of the F8 without 
augmentation will be the baseline dynamics.* The dynamics 
we will use correspond to the aircraft operating at an altitude 
of 6096m and a speed of 190 m/sec (flight condition #11) . The 
short period dynamics are given by 

q = -.487q - 4.789a - 8.7436^ 

a = q - .836a - ,111 6 

^ e 

= [V(q-a)/57.3]x 32.2 (59) 

= .2818a + .0374 6 

e 

The short period dynamics have a natural frequency of 

coj^ = 2.28 and a damping of ^ = .29; this represents poor 

sp sp 

short period handling qualities [20] . 

The state equations corresponding to the above dynamics 
are given in Appendix C . 

d. Pitch CAS 


As noted above, the short period handling characteristics 
of the F8 at flight condition #11 leave much to be desired. 
Moreover, we are interested in the effects of simulation param- 
eters as a function aircraft dynamics. A pitch command aug- 
mentation system designed by Honeywell [16] to improve the F8 

* A preliminary analysis incorporating the phugoid mode was also 
conducted, but the differences observed did not warrant the 
additional complication . 
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handling will be used here to generate an additional set of 

longitudinal handling characteristics. The pitch CAS design 

corresponds to a C* model-following system with angle-of-attack 

limiting and trim. For our linearized analysis we can modify 

the augmentation design of [16], Furthermore, a substantial 

reduction in the order of the system needed to represent the 

CAS is possible by noting pole-zero cancellations.* The reduced 

order pitch CAS is illustrated in Figure 14. In this Figure, 

2 

6 is the pilot commanded stick (in ft/sec ), is the cross- 

over velocity in the C* specification, and the K's are system 
gains. ^ gain scheduled with dynamic pressure. The 

parameters of the system have the following values : 


V 

CO 

324 


K * 
c 

.158 

g 

I CO 

= ,00064 X 57.3 = .0369 

= 

.082 


Kg/K^O = 

. 72 



With these parameter values the state equations for the 
augmented system are as given in Appendix C . Note the control 
input for these equations is the pilot input and the actual 
elevator deflection is an additional response variable , 


* In an actual CAS implementation, this might not be desirable 
as the eliminated lags are needed for noise suppression, etc. 
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Figure 14. - Reduced-Order Pitch CAS. 















r 


The F8 with the pitch CAS has short period roots with a 
natural frequency of “ 2.7 8 and a damping of = .64; 

this constitutes a significant improvement in the short period 
handling qualities. 

4.1.2 Lateral Tracking 

The lateral tracking task of [20] was self-excited and, 
therefore, somewhat difficult to analyze. We will examine an 
independent lateral task with target motion. 

a . Geometry 

The geometry for lateral tracking, or tracking in the 
transverse plane, is illustrated in Figure 13b. For small angles, 
constant and equal velocities, we obtain 

^’I’t " 1 i U-^3) (60) 

b. Target Motion 

Unlike the longitudinal tracking problem, it is important 
to include target attitude (roll angle) as a cue for lateral 
tracking (because of the essentially third-order transfer between 
error and control, the tracking task is extremely difficult with- 
out this information) . Thus we wish to include target roll angle 
in the definition of random target motion. We shall assume that 
the target turns are all coordinated (so Yt^ = • The lateral 

target motion equations are then assumed to be generated by pas- 
sing zero-mean, white, gaussian noise, w, through the filter. 
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The e (a small number) in the third filter is included to keep 
steady-state variance of finite. Note that V is the 
lateral acceleration of the target. 

c . Lateral Aircraft Dynamics 


The lateral equations of motion for the F8 at flight 
condition #11 are 

p = -2.58p + .251r - 37.86 + 17.246^ + 7.0166 

■A r 

r = -.0753p - .273r + 4.363 + .8166 - 3.186 (61) 

B = . 078p - . 994r - . 2296 + .05173(|) + . 04566 ^ 

(}) = .997p + . 078r 


to which we add 

}\) = r 


The roots of the lateral characteristic equation yield a 
roll time constant of .42 sec, a (stable) spiral time constant 
~ 40 sec and dutch roll frequency of = 2.64 and damping of 

= .128. 
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d. Lateral CAS 


The lateral tracking task described above is very difficult. 
Furthermore, the lateral handling qualities are marginally in- 
adequate with respect to the Dutch Roll response = .128 < .19, 

^d ^nd = • 34 < .35) and the roll response could also be improved. 
Finally, we are interested primarily in a roll-axis lateral track- 
ing task. For these reasons we will modify the basic aircraft 
dynamics by incorporating a modified version of the Honeywell 
lateral directional CAS with Inertial Coordination [16] . The 
yaw-axis CAS of [16] has been simplified by assuming |rp|< 1, ignor- 
ing the accelerometer lag and the integrator for trim 
and eliminating the aileron-to-rudder crossfeed. With these sim- 
plifications, the equations for the augmentation system are 


p = -5 p + 56 

- m ^m ap 


Pb = Pm ’ P 


6, = r-a_p-^(|) 


^ £ 

o ^ V 


(62) 


= r - ^ (j) -K^ P 
R V ^ Rp 


^AC = ' P> ' ^A6 ® 


'^RC ^'rB '^ap ''' ^R Pm 

nysL ^ urn ^ pm 


The parameters and gains are 
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a = 4,5® = .0785 rad 
o 

g/V = .0518 (1/sec.) 

.03226 (sec.) 

.126 deg/ ( f t/sec^ ) 

= (.16a + .008) X 57.3 = 1.146 deg/deg 
um 

„ = -.la + .012 = .00415 (sec.) 

pm 

= .54a + .042 = .084 
P 

The state equations are given in Appendix C. We have assumed 
that no pedal inputs are required. The characteristic roots for 
the augmented system yield a Dutch Roll response with = *62 
and 03^^ = 2.84, a roll subsidence time constant of .23 sec and 
a spiral time constant of 77 sec. In addition, there is a root 
from the roll-rate command mode with x = .2 sec. 


Ka 3 " (-V.29a + .54) = - 
= -.11 (sec.) 

= .714 (sec.) 

K = .0022 X 57.3 = 

nysl 


110 



e . Coordinated Lateral Dynamics 


A simplified set of dynamics incorporating turn coordina- 
tion can be derived directly. These dynamics do not incorporate 
practical CAS features but they can be a useful , simpler alter- 
native. They are obtained by assuming that all turns are 
coordinated. Thus, 

3 = 3 = 0 


= 2 


r = ^ (p = ifj 


( 63 ) 


6=0 

r 


The state equations for these assumptions are given in Appendix C 
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4.2 Parameters of OCM 


Parameters for the OCM had to be chosen for the analysis. 
In particular, the parameters corresponding to human limita- 
tions and the cost functional weightings for the lateral con- 
trol task had to be selected. The values used and their 
method of determination are described briefly here. 

The parameters describing the human limitations are 
listed in Table 5. The time delay and motor noise ratio are 
set at nominal values used in past OCM applications [5] . 


Table 5 

OCM MODEL PARAMETERS 


Parameter 

Value 

Time Delay (t) 

. 2 second 

Neuro-Motor Time-Constant 
(T ) 

~ . 15 second 

Base Observation Noise 

Ratio (p,- . ) 

Yi 

-14 dB 

Attention to Longitudinal 
and Lateral Tasks (fj^) 

. 5 

Motor Noise Ratio (Puj^) 

-25 dB 

Visual Threshold: 

.05 deg. visual arc 
.2 deg. /sec 
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Neuromotor time constants were selected via sensitivity analyses 
as described in Section 2.1,5. There is some subjectivity in 
selecting "operating" points from the various sensitivity curves, 
but a value of about .15 sec. for all the F8 tasks considered 
here' seemed reasonable.* The base observation noise ratio of 
-14dB is greater than the value of -20dB nominally assigned to 
this parameter [5] . The nominal value curresponds to a fairly 
constrained laboratory situation in which the subject is highly 
trained, and receives substantial performance feedback and moti- 
vational input. For larger-scale simulations the same degree 
of training is unusual and higher noise ratios appear to be 
appropriate . 

It was assumed that the pilots would divide their attention 
equally between longitudinal and lateral control tasks. Further, 
we assumed that there was no attention-sharing among individual 
display variables within a task. This corresponds to assuming 
that the visual presentation of target and horizon are effec- 
tively integrated. These assumptions are reasonable and are 
the simplest we can make; past experience with the OCM indicates 
that in most cases performance is not very sensitive to atten- 
tional allocation so long as a reasonable allocation is used. 

The final parameters describing operator limitations are 
the visual thresholds. These were set at the values determined 
in [21j . They proved to be of negligible importance in this 
study . 


* In the two-control, unaugmented lateral task the time constant 
associated with rudder control was ~.17 seconds. This value 
was a consequence of penalizing rudder control rate variances 
twice as much as aileron control rate variance in the quad- 
ratic cost functional. 
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Application of the OCM also requires specification of a 
quadratic cost functional embodying the task requirements . For 
the longitudinal tracking task, the cost functional was simply 
a weighted sum of tracking error and control-rate with the 
relative weighting selected to give the desired value of Tjyj. 

This situation is identical to that employed in laboratory 
tracking tasks [5] and gives reasonable results because the 
LOS tracking error contains both inner- and outer-loop variables 
(see Equation (57)). 

The cost functional for lateral control tasks was more 
complex. For the CAS-ON and coordinated dynamics, the cost 
functional included a roll error term, (cpr^-cf)) ^ , in addition 
to the tracking-error and aileron control-rate terms. It was 
found that penalizing LOS tracking error about three times as 
heavily as roll error gave a reasonable mixture of response 
errors . 

For the CAS-OFF configuration, sideslip angle and rudder 
control-rate terms had to be added to the cost functional . 

The relative penalties on LOS error and roll error were left 
unchanged from those for the simpler lateral tasks. Sideslip 
angle was penalized as heavily as LOS error and, as noted 
previously, the weighting on rudder control-rate variance was 
twice that on aileron control-rate variance. 

The above parameter choices are not necessarily expected 
to lead to precise performance predictions. They are intended 
to give reasonable estimates of performance and relative work- 
load for the tasks considered. More importantly, predicted 
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changes in performance and workload as a function of simu- 
lation parameters should be relatively insensitive to small 
variations in OCM model parameters* , and these trends are the 
results of interest here. 

4.3 Model Res ul ts 

4.3,1 Continuous Model 


The continuous model was used to analyze the effects of 
both simulation parameters and problem variables. With respect 
to the simulation, the effects of integration scheme, servo 
bandwidth, the order of the hold and the de-aliasing cut-off 
frequency are investigated for the longitudinal CAS-OFF dynamics 
and for the coordinated dynamics. Problem dependent effects 
are explored by comparing CAS-OFF and CAS-ON results for both 
longitudinal and lateral tracking and by changing input band- 
width for longitudinal tracking. 

a. Overall Effects of Simulation 


We shall define a basic simulation configuration corres- 
ponding to Figure 4 in which the cutoff of the de-aliasing filter 
is set at half the sample frequency, the visual servo has the 
DMS characteristics (c = .707, = 25) , and a zero-order hold 

is used in data reconstruction. 


* This was confirmed, at least partially, by preliminary sensi- 
tivity studies. 
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Figure 15 gives normalized performance for the basic con- 
figuration as a function of sample period and integration scheme 
for longitudinal CAS-OFF, wide-band target tracking and for 
lateral tracking with coordinated dynamics. Normalized per- 
formance is defined as the tracking error obtained for the 
simulation configuration divided by the tracking error that 
would be obtained in a continuous simulation with no delays 
(or in flight).* The normalization is determined by computing 
the performance utilizing the original, continuous state equa- 
tions and assuming the only delay is that of the operator 
(.2 seconds) . The scores used in normalizing the results (plus 
those for other variables) are given in Table 6, 

Figure 15 shows substantial effects are introduced by the 
simulation, particularly at low sample rates. Even for the 
highest sample rate (T = .03125), there is a 16-20 percent 
performance degradation for longitudinal tracking and a 20-28 
percent degradation for the lateral task. A change of this 
magnitude exceeds the normal intra- and inter-subject varia- 
bility in manual tracking tasks and would, therefore, be 
expected to be significant. For the lowest sample rates the 
performance degradation ranges from 35-60 percent, numbers 
that are clearly consequential. It is clear that, from a 
closed-loop tracking standpoint, A-B integration is superior 
to Euler integration. We note, too, that the effects are 
somewhat more severe for lateral tracking than for the longi- 
tudinal task. 

The results in Figure 15 assume that the only adjustments 
in pilot strategy resulting from the simulation are an increase 


* As might be the case in an all analog simulation with electronic 
displays providing undelayed visual information. 
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TABLE 6 


RMS PERFORtlANCE SCORES PREDICTED 
FOR CONTINUOUS SIMULATION 


a) Longitudinal Dynamics (Wide Band Input) 


VARIABLE 

CAS-OFF 

CAS -ON 

R8^,m (ft) 

23. (75.6) 

22.3 (73.1) 

0 , deg 

16.0 

16.0 

g’s 

3.02 

3.02 

6^, deg 

6.45 

6.66 


b) Lateral Dynamics 


VARIABLE 

CAS-OFF 

CAS -ON 

COORDINATED 

R£^^m (ft) 
(4)-4)^) , deg 

4.9 (15.9) 
13.4 

7.62 (25.0) 
18.6 

5.8 (18.9) 
14.4 

3 / deg 

1.39 

1.86 

- 

ny, ft/sec^ 

2.45 

4 .53 

- 

5^/ deg 

4.1 

1.50* 

4.9 

6 ^, deg 

2.33 

3.54* 



Generated by CAS 




















NORMALIZED PERFORMANCE NORMALIZED PERFORMANCE 




Figure 15. - Effect of Discrete Simulation on 
Normalized Performance. 
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r 


in prediction time to compensate for simulator delays and the 
adoption of an internal model that accounts for the amplitude 
distortions (and pole perturbations) introduced by the CPU. 

The results are based on the assumption of a fixed level of 
attention throughout. However, the pilot may choose to devote 
more attention to the task (work harder) and, thereby, reduce 
tracking error. A reasonable question to ask, then, is "How 
much more attention to the task would be required to achieve 
performance levels comparable to those that could be obtained 
in a continuous simulation?" This question can be addressed 
using the model for workload associated with the OCM [18] . 

Figure 16 shows the sensitivity of performance to changes 
in attention as a function of sample period. An attention of 
1 on these curves corresponds to an observation noise tatio of 
-14 dB (with attention shared equally between longitudinal and 
lateral tasks) . Curves are only presented for Euler integra- 
tion and longitudinal, GAS-OFF dynamics. If a horizontal line 
is drawn through the T = 0 curve at the point of unity atten- 
tion, the intersection of this line with the remaining curves 
defines the attention necessary to achieve the same performance 
as for continuous simulation. The result of this operation is 
plotted in Figure 17 which also includes results for A-B inte- 
gration and for lateral tracking. 

It can be seen from Figure 17 that to achieve the perform- 
ance equivalent to that for continuous simulation, the pilot 
would have to increase his attentional workload by factors up 
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0 0.05 0.1 0.15 

SAMPLE PERIOD (sec) 

Figure 17. - Simulation Workload Penalties. 
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to three for the conditions considered.* This is a substantial 
workload penalty and it might be expected that a compromise 
between performance degradation and increased workload might 
evolve. This would be the case, especially if the pilot had 
not flown the vehicle or a continuous simulator in the same 
task so that there would be no basis for setting a criterion 
level of performance. 

Before leaving the workload question, a further point is 
worth noting. In the describing function literature, it has 
been common practice to associate workload with the generation 
of lead (see, e.g., [221). However, there has been no quanti- 

tative connection between the amount of lead and the increase 
in workload. In the present context, one can think of the 
increased prediction time necessary to compensate for simula- 
tor delays as imposing a (processing) workload analogous to 
that of lead generation. The measure of attentional workload 
given previously may then be thought of as an alternative 
means of quantifying the workload imposed by the requirement 
for additional prediction. 

b . Effects of Simulation Components 


We have just seen that a basic discrete simulation of an 
aircraft tracking problem could lead to a serious performance 
or workload penalty when compared with a continuous simulation 
with no delay. We now examine the contributions of individual 


* It is interesting that the workload penalty for the coordinated 
lateral task is less than that for the longitudinal task. This 
is the reverse of the performance trend. 
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simulation elements to the degradation in performance. Workload 
is not discussed here, but it is expected that each element 
would contribute to the penalty in approximate proportion to 
its percentage contribution to the performance penalty. 

Discrete Integration 

The previous results show A-B integration superior to 
Euler integration but the differences are masked to a degree 
by the contributions of other elements. Figure 18 isolates 
the effect of the integration scheme. Performance has been 
computed, assuming no delays for de-aliasing filter, servo 
or hold, and normalized as in Figure 15. These results empha- 
size the advantage of A-B, especially with increased sample 
periods. Comparison with Figure 15 shows that at the longest 
sample period, the CPU accounts for 40 percent of the total 
change for Euler but only about 15 percent for A-B. 

It is of interest to know how significant the amplitude 
distortion and pole perturbations are in comparison to the 
delay. Figure 18 also shows the result of assuming that only 
integration delay is important in Euler integration.* (The 
system model then corresponds to the continuous model plus an 
equivalent integration delay.) The results confirm that, for 
these dynamics and this task, delay is the most significant 
contribution to performance degradation. 


* The amplitude distortions are minor for A-B and, as has been 
noted previously, it is difficult to get an appropriate esti- 
mate of the A-B delay if these distortions are ignored. 
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Vtsuat Servo Dynamics 


Figure 19 shows the effect of visual servo dynamics. 

Results are for the basic configuration and for an identical 
configuration with an infinite bandwidth (zero delay) servo. 

The visual servo dynamics contribute from 10-14 percent of the 
total performance loss in the simulator. The lateral task is 
degraded more than the longitudinal, but the differences are 
small. There is a slight increase in effect with sample per- 
iod even though the servo delay is independent of sample period. 
This undoubtedly results from the fact that as the sample period 
is increased the system is degraded (stability margins, etc.), 
so that adding a fixed delay will have a more pronounced effect. 

Data Hold 

Figure 20 shows the effect of replacing the zero order 
hold in the basic configuration with a first-order hold. As 
noted earlier, the continuous model can only indicate a degra- 
dation in performance due to the increased delay. Figure 20 
shows that the delay associated with the first-order hold has 
a significant effect (12 percent) only at the largest sample 
period. The effect is not very large, even for T= . 1 . Inas- 
much as the benefits associated with a first order hold should 
increase with increasing sample period, it is possible that 
the differences shown in Figure 20 will be cancelled. 

De-aliasing Filter 

As in the case of the data hold, the continuous model will 
only show degradation in performance with reduction in filter 
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Figure 20.- Effect of Data Hold. 
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cut-off frequency. Figure 21 shows the magnitude of this degra- 
dation for the nominal filter cut-off of = 2 ^ as compared 

with an The curves include the effect of (Euler) inte- 

gration and a zero-order hold, but it is assumed that 03^ = 

The results depend on sample period, as expected, and range 
from 4-16%. The lateral task suffers a somewhat greater loss 
in performance than the longitudinal as was the case with other 
simulation parameters. 

Control Load'ing 

We consider here a closed loop control loading system 
involving a linear control loader servo with digital feedback 
of spring gradient forces. Feedback of bob-weight forces is 
not considered. The system is based on that employed in the 
DMS [15] . A sampled data model for this control loading 
system has been developed in [23] and we will use the results 
obtained there in our analysis. 

From the standpoint of system dynamics, the control loader 
introduces a second-order filter between the pilot's stick input 
and the elevator deflection. The filter, when implemented con- 
tinuously, has a natural frequency of go^= 28 rad/sec and a 
damping coefficient of 6=.7. The open-loop effect of digital 
implementation of the control loader is to modify the frequency 
of this filter as shown in the table below. (The damping 
of the control loader is assumed to be adjusted using hardware 
damping, to a value of 6 = .7 for all sample periods; this 
assumption is consistent with what has become standard practice 
in use of the system.) [23]. 
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EFFECT OF DIGITAL IMPLEMENTATION OF CONTROL LOADING 


Sample Period 

0 

.03125 

. 0625 

1 

0 )^ (rad/sec) 

28 

19.5 

12.5 

8.8 I 


The effects of digital implementation of the control loading 
system on closed- loop performance are shown in Figure 22. Also 
shown is the predicted performance for an analog implementation 
of the control loader. Such an implementation was suggested in 
[23]. For both cases, it is assumed that the rest of the simu- 
lation has the basic configuration described in Section 4. 3.1. a, 
and that Euler integration is used. Performance is normalized 
to that obtained for a continuous system without control loading. 

We note first, from Figure 22, that the control loading 
dynamics degrade tracking performance in this task, even in the 
continuous case. However, one should interpret this result 
cautiously inasmuch as the potential advantages of the kines- 
thetic cues provided by the loader are not considered. Essen- 
tially, the result means that adding filtering in the forward 
loop degrades tracking performance. Digital implementation of 
the control loader decreases the effective bandwidth of this 
filter causing further loss of performance. The overall effect 
can be sugnificant at low sample rates amounting to about 15% 
for T=.l. If control loading is necessary the analog implemen- 
tation seems desirable. With this implementation, the dele- 
terious effects decrease in significance with increasing sample 
period because the effects of other simulation components become 
dominant . 
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ERROR WITH CONTROL LOADING 
ERROR (NO CONTROL LOADING) 



Figure 22. -Effect of Control Loading. 
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c. 


Effects of Problem Variables 


It was anticipated that there would be an interaction 
between the effects of simulation parameters and problem vari- 
ables such as vehicle handling qualities and input bandwidth. 
Thus, the above tasks were analyzed for different vehicle con- 
figurations* and changes in input characteristics. 

Input Bandwidth 

A limited investigation of the effect of input bandwidth 
was conducted. Longitudinal CAS-OFF dynamics and the basic 
simulation with Euler integration were considered. The input 
was the narrowband tracking input ~ .2) described in Section 

4.2. The tracking error for the narrowband input was approxi- 
mately one-third that for the wide band input. However, Figure 
23 shows that when scores are normalized to the continuous 
result, the discrete simulation has a greater effect for the 
narrowband- input than for the wideband-input. This result is 
somewhat counter-intuitive. Apparently, with the wide-band 
input the inherent task difficulty dominates the situation and 
the effects of simulation delays, etc., are muted to some 
extent; when the input is made less demanding, the effects of 
the simulator on performance are emphasized by comparison. 


* The effects of vehicle handling are also examined in Section 4.4. 
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Vehi^ole Dynamics 


Figure 24 compares normalized longitudinal CAS-ON and 
CAS-OFF performance for the basic simulation. It can be seen 
that the CAS-ON perforamnce is degraded more by the discrete 
simulation than the CAS-OFF performance. These results are 
explained by the fact that the integration delays are larger 
for CAS-ON dynamics than they are for CAS-OFF dynamics (see 
Table 3) . 

The effects of longitudinal dynamics when viewed in terms 
of absolute performance are interesting and are also shown in 
Figure 24. The absolute performance for continuous simulation 
is better for CAS-ON than CAS-OFF (by about 3.5 percent) and 
the sensitivity to incremental computation delay is about the 
same for the two configurations. Thus, for a given simulation 
configuration, absolute performance for CAS-ON and CAS-OFF 
configurations will be about the same if Euler integration is 
used and the CAS-OFF configuration can give better performance 
if A-B integration is used. In other words, the discrete simu- 
lation washes out any improvement due to the CAS 1 

Figure 25 provides comparative results for the three lateral 
configurations considered. The results do not include any 
amplitude distortion or pole perturbation effects in the CAS-ON 
and unaugmented cases. (Recall that approximations to the 
discrete transfer functions for the CAS-ON and unaugmented 
lateral dynamics were not obtained.) Also, results are only 
shown for the basic simulation with Euler integration. All 
results are normalized by their respective continuous simula- 
tion performance. 


134 



NORMALIZED PERFORMANCE 




Figure 24.- Effect of Vehicle Longitudinal Dynamics 
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It can be seen that the coordinated dynamics exhibit the 
most substantial simulation effect. This does not result from 
amplitude distortions but, rather, from the added delay for 
tracking error (see Table 3) . CAS-ON and CAS-OFF configura- 
tios display about the same sensitivity to sample period. 
Tracking error is smallest for the CAS-OFF configuration as 
is the percentage degradation due to simulation (Figure 25) . 

The CAS-OFF configuration may give the best performance because 
it is the least constrained system.* However, the requirement 
for manual rudder control may impose a workload penalty that 
offsets the performance advantage for the unaugmented system. 

4.3.4 Hybrid Model 


The hybrid model was used to investigate several issues 
that could not be examined readily in the continuous model 
context. However, results were also obtained for conditions 
that would allow comparison with the continuous model . Results 
with the hybrid model were limited to the longitudinal unaug- 
mented dynamics because of cost and time considerations. The 
results obtained are presented and discussed below. 


* The lateral CAS attempts to keep sideslip angle and lateral 
acceleration small and this inhibits the transverse tracking, 
resulting in larger errors for the target motion considered. 
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Effect of Operator Predtotton T-ime 


It is reasonable to assume that a trained operator will 
attempt to compensate for the delays introduced by the discrete 
simulation. Moreover, it is expected that an optimal policy 
is to predict ahead a time equal to the simulation delay. In 
the hybrid model, operator prediction time* (in number of 
discrete time steps. A) is a parameter (see Section 3.2.3). 
Thus, it is possible to determine the effects of prediction 
time on performance. 

Figure 26 shows the sensitivity of performance to pre- 
diction time (referred to as delay compensation) for the basic 
simulation configurations with both Euler and A-B integration 
and for T = .1 and T = .0625. The "internal" models for the 
OCM in these cases are the continuous approximations to the 
discrete transfers that incorporate amplitude distortion 
effects; however, no delay is added to the human's delay of 
.2 seconds to account for the simulations delays. Thus, we 
expect the optimal prediction times to be approximately equal 
to the delay introduced by the simulation. This is indeed 
the case as can be seen in Figure 26. For Euler integration 
the minima occur at -.26 sec and -.2 sec. for T = .1 and 
.0625, respectively; the corresponding simulation delays are 
. 27 and . 19 . 


* In excess of the basic prediction time needed to compensate 
for the operator's delay. 
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For A-B integration the minima are at larger compensation 
times than for Euler. This is consistent with the "zero-model- 
ing" introduced to account for amplitude distortion. With 
T = .1, the optimal prediction time is around .3 seconds and 
the simulation delay is ~.32 seconds. For T = .0625, perform- 
ance does not appear to be very sensitive to prediction time 
in the neighborhood of the optimum. The simulation delay is 
~.21 seconds and performance for this prediction time is in- 
distinguishable from optimal performance. Figure 26 also shows 
a curve for the case in which the operator's internal model 
does not include a zero to match the amplitude distortion of 
A-B integration. It was found that for this case a delay 
compensation of only .17 seconds was required. This corres- 
ponds to the delays introduced by the servo, pre-filter and 
zero-order hold. The optimal performance was marginally poorer 
than for the case with amplitude distortion included in the 
internal model. These results suggest that although including 
the zero provides a better model of the effect of A-B inte- 
gration, the increased delay compensation needed to offset 
the extra lead should not be viewed here as a workload penalty. 

These results confirm the estimates of simulation delay 
used in the continuous model. They also demonstrate implicitly 
how operators may adapt their behavior to compensate for simu- 
lator inadequacy. The added prediction required may impose 
a workload penalty as noted earlier. 
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Intevnat Model 


Two questions concerning the pilot's internal model are 
of interest: 1.) What model will the trained operator adopt 

when "flying" the simulator?; and 2.) What is the "transfer" 
effect of a wrong model when transitioning from discrete simu- 
lator to continuous simulator (flight) ? At least partial 
answers to these questions for the longitudinal dynamics and 
Euler integration are provided by the results shown in Figure 
27. 

Figure 27 gives performance vs. delay compensation for 
T = .1 and two internal models. One internal model is that 
derived to match the corresponding discrete transfer function 
while the other is the basic continuous model. It can be seen 
that better performance is obtained when the internal model 
corresponds to the approximate discrete model implying that 
this is a better model of the discrete simulation than is the 
original continuous model. 

Figure 26 also shows the effect of using the model cor- 
responding to T = .1 seconds in a simulation where T = .03125 
seconds (i.e., nearly continuous) as compared to using the 
model for T - .03125 seconds (i.e., the correct one) . If the 
operator optimizes delay compensation, performance will be 
degraded by about 10%. If, on the other hand, the delay com- 
pensation appropriate to T = .1 is used, a performance penalty 
of about 19% will be incurred. The effect is not substantial 
here but it might be in other tasks. 







De-at'ias'ing Fi-Ztev 


The effect of the cutoff frequency of the de-aliasing filter 
on performance is shown in Figure 28. Euler integration of the 
vehicle equations is used and other simulation parameters cor- 
respond to the basic configuration. The results are for a sam- 
ple frequency of 10 Hz (T = .1) so a cutoff frequency o f 0 )^ = 5 Hz 
satisfies the Nyquist requirement. Results are obtained for 
w = 1, 5 and 20 Hz respectively. The lowest value of u) = 20 Hz 

C w 

is based on the assumption that there is not significant signal 
power beyond 5 Hz so there is no heed to set the filter break- 
point at that frequency and incur the delay penalty. 

The results in Figure 28 favor using the higher cutoff 
frequency, = 2 0 Hz, for this problem. Furthermore, there 
is a substantial penalty for using the low frequency cutoff. 

These two results imply that aliasing is not a problem here. 

We also note that the performance minima for = 20 Hz and 
5 Hz occur at about the correct value of prediction time; the 
optimum prediction time for = 1 Hz is much larger but not 
quite so large as the estimated total simulation delay of .53 
seconds . 

Data Hold 

The effects of using a first order hold instead of a zero 
order hood are shown in Figure 29 for both Euler and A-B inte- 
gration at T = .1 and for Euler integration at T = .0625. 
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Figure 29. - Effect of First Order Hold (Hybrid Model). 
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The corresponding best zero order hold performance values are 
also shown for comparison purposes. 

At a sample period of .1 seconds, slightly lower tracking 
errors are obtained for Euler integration with a first order 
hold than with a zero order hold; in addition, the minimum per- 
formance is obtained with less delay compensation. The situa- 
tion for A-B integration and a .1 second sample period is the 
reverse of that for Euler, That is, for A-B integration the 
first order hold degrades performance. 

A possible explanation for these results is as follows. 

The first order hold uses intersample information which pro- 
vides some lead. For long sample periods and Euler integra- 
tion, the effective lead provided is apparently more beneficial 
than the lag penalty associated with the higher order hold. 

The beneficial effects of a first order hold should decrease 
as the sample period decreases. This is supported by the 
results for T = .0625 which show no difference between the 
two holds.* In the case of A-B integration the added delay 
of the first order hold dominates. This may be due to A-B 
integration having an implicit first order hold at the input 
(See Section 3.2), thereby reducing any advantage in adding 
such a hold at the output. 


* The delay for the first order hold also decreases with decreas- 
ing sample period but it remains twice as long as that for the 
zero order hold. 
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Comparison with Continuous Model 


We have seen, thus far, that the trends of the hybrid 
model either confirm those of the continuous model or they 
differ in ways that are interesting but can be explained. 

The absolute performance predictions of the two models have 
not been compared yet. This is done in Table 7 and reveals 
that the two models do not yield the same tracking performance 
prediction. Moreover, the differences between the two cannot 
be ascribed to statistical variance associated with the Monte 
Carlo nature of the hybrid model. 

Table 7 

COMPARISON OF LONGITUDINAL TRACKING 
ERRORS PREDICTED BY TWO MODELS 



Euler 

Adams -Bash forth 


Continuous 

Hybrid 

Continuous 

Hybrid 

T = .1 

115 

92 

102 

81.5 

T = .0625 

103 

71.2 

94 

65.0 


It can be seen from Table 7 that the hybrid model gives 
consistently lower scores than the continuous model. In addi- 
tion, for a given integration scheme, the relative change in 
performance as a function of sample period is substantially 
greater for the hybrid model than for the continuous model. 
(However, for a given sample period, both models predict the 
same relative improvement in going from Euler to A-B integration.) 
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It appears at this time that the OCM in the hybrid model 
is obtaining better rate information from the visual servo than 
is assumed for the continuous model. This was verified by 
replacing the scaling observation noise on the rate variables 
in the hybrid model with an additive noise equal to that 
obtained with the continuous model.* This makes the differ- 
ences between the two model results negligible. A potential 
explanation for this phenomenon of better rate information 
lies in the nature of the data reconstruction process. The 
visual servo is driven by a -series of step inputs from the 
data hold. The rate response of a continuous servo to a step 
is a pulse the shape of which depends on the response of the 
servo and the sample period. It is possible that scaling rate 
observation noise with this pulse signal leads to smaller 
effective noises than would be obtained if it were scaled with 
a smooth signal (as assumed in the continuous model) . Alter- 
natively, the pulse-like nature of the response may provide 
an onset cue (lead) that is being used by the hybrid model 
in an, as yet, unexplained way. 

It should be noted that the hybrid model of the visual 
servo responds in essentially the same way as would the actual 
visual servo in the simulation. On the other hand, the operator 
may perform a smoothing operation that would result in perform- 
ance closer to that of the continuous model and this smoothing 
is not incorporated in the hybrid model. At this time, without 
data, we are unable to resolve the question of which model gives 
better predictions of absolute performance. 


* The additive noise in the steady-state case computed by multi- 
plying the steady-state variance of the signal by the noise 
ratio. 
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Finally, we believe that the discrepancy between the 
two models in prediction of absolute performance, does not 
negate the comparisons made within either model. 
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4.4 Preliminary Validation 

In this section, the continuous model is used to obtain 
results that can be compared with data obtained previously in 
an independent experiment. The goal is to show, at least in 
a preliminary way, that closed- loop models provide a valid 
means of analyzing simulation effects. 

The data we shall use for comparison purposes are taken 
from [20] . The experiments were conducted on a fixed base 
simulator with the objective of studying the effects of visual 
delays on pilot performance and "behavior" and the interaction 
of those effects with vehicle handling characteristics. The 
piloting task was to track a target executing a sinusoidal 
maneuver in altitude. The pursuing aircraft had five degrees 
of freedom (two longitudinal, three lateral) . Time delays 
were introduced inthe visual display of target azimuth and 
elevation errors. An irreducible delay of .047 seconds was 
assumed for the simulation and delays were added in units of 
.03125 seconds. 

Experimental details may be found in [20]. However, a few 
points concerning the experiment are worth mentioning prior 
to comparing the data with the model results. The sine wave 
used for the target had a frequency of .21 rad/sec which 
should prohibit pre-cognitive tracking. Nonetheless, given 
the large number of runs needed to explore all the conditions 
of interest it would seem that learning of the input would 
take place to some degree. The input for lateral tracking. 
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on the other hand, was completely random being self- induced by 
inadvertent pilot inputs to the lateral axis; in other words, 
lateral errors were due solely to pilot remnant. Performance 
measurement was in terms of altitude and transverse distance 
errors but the displayed errors were line-of-sight angular 
errors . Perhaps the most important factors to bear in mind 
in considering the experimental data are that almost all data 
are for a single subject (apparently one of the investigators) 
and there is considerable reason to suspect that training 
effects could bias the data. 

The model was used to analyze only the longitudinal track- 
ing task considered in [20] . To avoid questions about the 
pilot's knowledge of the sine-wave input, target altitude was 
assumed to be generated by passing white noise through a 
second-order Butterworth input. The frequency of the filter 
and the rms altitude deviations of its output were set to the 
corresponding sine-wave values of the experiment (i.e., co = .21 
rad/sec and (h^) = 21.55m) 

Because of the unknown learning effects and the fact that 
a single subject was used for most of the experiment, OCM model 
parameters were selected to match the base delay (.047 second) 
case for each vehicle configuration considered, as follows. 

Human operator time delay was fixed at .2 seconds for all cases. 
The neuromotor time constant was picked to match the ratio of 
control and control-rate scores for each configuration. The 
values so obtained varied from a TN = .13 sec. to TN = .22 
sec. , within the range that could be anticipated for this low 
bandwidth task. Noise ratios were selected to match error 
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scores (to within about one standard deviation) . Motor noise- 
ratio was set at the "nominal" value of -25 dB for all cases 
except configuration 1, where a value of -22 dB was used to 
obtain a better match to performance. Observation noise ratios 
for the longitudinal task ranged from about -12 dB to about 
-21 dB . The noise ratios generally decrease as the configura- 
tion number increases. The observation noise ratios appear 
to be on the low side for the high numbered configurations 
given the additional tasks the operator was required to per- 
form (lateral tracking plus a side task). The lower values 
may be a result of a training effect (if configurations were 
run sequentially) * or they may be due to the simplicity of 
the experimental input. 

Model results were obtained for five configurations 
(listed in Table 8) that covered a range of longitudinal hand- 
ling qualities. Configuration numbers correspond to those 
used in [20] . Figure 30 compares model predictions of the 
effects of incremental delay with the corresponding experi- 
mental results. It is important to note that the model results 
were matched only to the 1.5 unit delay cases. It can be 
seen that model predictions are generally within t. la of the 
data for the added delay cases. Furthermore, the relative 
sensitivity to delay as a function of configuration tends to 
parallel that of the data, except perhaps for configuration 8 
at the higher delays. 

* As could be the case for the higher motor noise needed to 
match configuration 1. 
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Table 8 


LONGITUDINAL CONFIGURATIONS [20] ANALYZED 


Conf. No. 

03 

n 

C 

M 

a 

Mq 

L 

a 

1 

1.5 

. 3 

-4.45 

1.10 

2.0 

4 

2.5 

. 2 

-8.25 

1.00 

2.0 

6 

3.0 

.7 

-4.50 

-2.2 

2.0 

8 

2.83 

1.59 

6.00 

-7.00 

2 . 0 

13 

4.5 

. 70 

-11.65 

-4.3 

2.0 


Figure 30c demonstrates two interesting effects. First, 
for this configuration, data were available from two subjects 
and these data tend to bracket the model data. Second, data 
were obtained for a target frequency of twice the base fre- 
quency. To "predict" this effect the frequency of the Butter- 
worth noise filter was doubled and all other parameters were 
left unchanged. The resulting predictions, though less accu- 
rate, are the right order of magnitude and capture the effect 
of changing target frequency. 

The limited results presented in this section demonstrate 
that delays can have serious effects and that the magnitude or 
the effect depends on problem variables. They also show that 
a closed-loop model can predict these effects reliably. This 
conclusion should be tempered somewhat by the fact that it was 
necessary to first match the results for the individual con- 
figurations before predicting the effect of the delays. 
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SUMMARY AND CONCLUSIONS 


In this report we have examined the effects of simulation 
parameters and components on simulator fidelity, particularly 
with regard to predicting operator performance and workload. 
Our focus has been on the dynamical aspects of simulator pri- 
marily as they relate to closed loop control. We have gener- 
ally ignored questions that would necessitate inclusion of 
detailed models for cue perception leaving these to future 
s tudy . 

The human pilot in closed loop control will operate on 
essentially continuous outputs to generate continuous control 
inputs. Thus, even when digital computers are used in an air- 
craft simulation, it is meaningful to consider a continuous 
transfer function approximation to the open loop simulation 
dynamics. Such an approximation was developed in this study. 
It consisted of a rational transfer function multiplied by a 
transportation lag. The rational transfer function approxi- 
mated the amplitude distortions introduced by discrete inte- 
gration of the flight dynamics. The delay accounts for all 
the phase lags introduced by the simulator components. These 
phase lags are the major source of degraded performance and 
increased workload in closed loop tasks. However, the ampli- 
tude distortions can be significant for open-loop responses. 

The approximate model was incorporated in the standard 
optimal control model for the human operator. The resulting 
continuous closed-loop model was used to analyze both overall 
simulation effects and the effects of individual elements. 
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The results showed that, as compared to an ideal continuous 
simulation, the discrete simulation could result in significant 
performance and/or workload penalties. The magnitude of the 
effects depended strongly on sample period as expected. From 
a closed-loop standpoint it seemed clear that A-B integration 
was much to be preferred. With respect to the other simula- 
tion components it can be said that any reduction in delay is 
desirable. Such reductions inevitably involve increased costs 
(hardware or software) which must be balanced against the 
expected improvements . 

In addition to the continuous model, a hybrid model was 
developed to allow us to investigate situations that could not 
be treated adequately with the continuous model. Several 
interesting results were obtained with this model. It was 
shown that for this (fairly typical) aircraft control problem 
signal bandwidths were such that the de-aliasing filter cutoff 
frequency could be set at a value greater than half the sample 
frequency. Also, there appeared to be a potential under cer- 
tain conditions for improved simulator performance with a 
first order hold (rather than a zero order hold) . The model 
was also used to show demonstrable effects for adopting the 
simulator dynamics as an internal model. Predictions of track- 
ing performance by the hybrid model did not agree with those 
for the continuous model. This discrepancy was not resolved 
but it appears to be associated with the perception of rate 
information from the visual servo. 

A preliminary validation of the continuous model was per- 
formed by comparing model results with data obtained in an 
independent experiment. The model was capable of predicting 
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the effects of computational delays in generating visual cues, 
once model parameters were chosen to match basic conditions. 

We believe the models developed here can be very useful 
in developing engineering requirements for flight simulators. 
These requirements will be problem dependent which is one 
reason why models are needed. As we see it now, the process 
for using the models would involve the following steps: 

i) Use standard OCM to analyze ideal continuous 
simulation to develop baseline performance 
and to determine expected signal bandwidths . 

ii) Analyze distortion introduced by discrete 
integration schemes and develop continuous 
models for discrete dynamics valid over the 
band of interest. 

iii) Analyze effects of integration, cue dynamics 
etc. using continuous model. 

iv) Use hybrid model to examine effects of data 
reconstruction, de-aliasing cutoff frequency 
etc . 

Before this procedure could be used with complete confi- 
dence the models described herein need further validation and 
extension. It is especially important to collect data in a 
carefully controlled experiment to verify the individual simu- 
lation effects. It is also important to resolve the differ- 
ences between hybrid and continuous models. Once these steps 
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are taken, the models should then be extended to account for 
the important issues in providing motion (and perhaps other) 
cues to the pilot. Finally, it would be useful for both models 
to develop continuous approximations corresponding to discrete 
integration of the lateral dynamics of an aircraft. 
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Appendix A 


SYSTEM FUNCTION FROM STICK 
INPUT TO DISPLAYED OUTPUT 


The system function G(s) for the simulation system under 
analysis may be obtained by computing its steady-state response 
to an input of the form e®^[2] . That is. 


G ( s ) — 


y ( t) 
-^ss 

u (t) 


u(t) = e®^ 


This definition works equally well for time varying parameter 
systems and for fixed-parameter systems. 


For the simulation system indicated in Figure 4 we have 


y(s) = D*(s) u^* (s) 


where 


u 


*l(s) = 


Uj_(z) 


z=e^T 


Using the formula 


Ul (z) = I 
poles 


of ( s ) 


residue 


U^(S) 'X 


the output response of the simulation system to an input 
s t 

u(t) = e ° is easily computed to be 


A-1 



N 


y (s) = (s) D* (s) I 


{ (s-s^)F^ (s) u(s) g 


14 


where Sj^ i=l , 2, . . . ,N are the distinct poles* of Fq^(s) and 
u(s) • If we drop the terms in u. * (s) corresponding to 

fa Sq X 

the left half s-plane poles, we obtain the steady-state response 


Ygs = ^2 






To compute ygg (t) by inverse Laplace transformation we note 
the following: 


i) — — I — has an infinity of isolated simple 

{l-e"^®"®o^^} 

poles at s = s^+jnf^, n=0 , il, Since 

Sq = jojQ for a cissoidal input u(t) , all these 
poles lie on the imaginary axis. 


ii) The inverse Laplace transform of f(s) is 

f f f (s) ® 

' ' 2i\j a-j°o 

= ^ residue {f(s)e^^} 
poles 
of f (s) 


iii) The infinity of poles associated with r-^ 

{l-e"^^"®i^^} 

i=l,2,...,N are all in the left half s-plane 
because s. are. 

X 

* Distinct poles were assumed, in order to keep the expressions 
simple. Besides, the pre-filter Fj(s) for the simulation system 
does indeed have distinct poles in the s-plane. 

** Strictly, any left half s-plane poles in F 2 (s)D*(s) should not 
be included in the exprewsion for Ygg(s) . The final result 
G(s;t) will not be affected, however, because we shall not include 
the contribution due to such poles while computing Ycc(t) and 
thenG(s;t). 
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iv) The inverse Laplace transform formula in (ii) 
is valid for a (meromorphic ) function of the 
type in (i) . 

v) s=0 is not a pole in ygg(s) • 

vi) The residue of ^ ^ at the pole s + jnf2 is 

{l_e“^s-So)T} o 


Using (i) - (vi) the steady state response is 

^ss^^^ " ^ F 2 (SQ+jn?^) D*(s (s ) 

^ n=-°o ' 

Hence, the system function G(s;t) from u(s) to y(s) is 




A ss 


G(s;t)= — 


u (t) 


u (t)=e' 


st 


= {^ I F 2 (s + jn^^) D* (s+ jnf^) F^(s) 


Since D* (s) is periodic in s with period , we have 


G(s;t) 


I F 2 (s+jn^^) D*(s)F^(s) 

n=-“ ^ 
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Appendix B 


ANALYSIS OF THE DISTORTIONS INTRODUCED BY DISCRETE INTEGRATION 
IN REAL-TIME SIMULATION OF CONTINUOUS DYNAMIC SYSTEMS 

B.l. Introduction 

The purpose of this Appendix is to examine the effects of 
various integration schemes in simulating the dynamics of a con- 
tinuous system. 


Consider a continuous system with state-space representation* 
x(t) = x(t) + u(t) 

(B-1) 

_y(t) - x(t) 

where Xf and u are, in general, vectors representing the state, 

output and input, respectively. For A , B and C constant, the 

c c c 

system Transfer Matrix is given by 


y (s) = (s) u(s) 


(B-2) 


When Equations (B-1) are "integrated" digitally, many inte- 
gration schemes lead to a discrete approximation to (B-1) of the 
form 


-k+1 -d “k -d % 


Ik = ^d ^k 


(B-3) 


* The results are easily modified to include a term in the output 
equation that is dependent linearly on control. 
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The specific approximations corresponding to a number of differ- 
ent integration formulae are derived in Section 2. Equation (3) 
has the following Transfer Matrix; 


H^(s) = {C^[z^-A^] 


-1 


B sT 
-d z=e 


where T is the sample period. 

We are interested in two problems: 
( i) Analysis Problem 


(B-4) 


How "closely" does the discrete system (3) approximate the 
continuous system (1)? 

(ii) Synthesis Problem 

Find a continuous system that approximates the continuous 
"simulation" system (from human control input to displayed output) 
in which the discrete system (4) is embedded. 

The second problem is clearly related to the first one but 
is not identical to it. Our interest in this problem stems from 
the need for a "continuous" model of the simulation that can be 
used with existing man-machine models to analyze closed-loop 
performance and workload. In the remainder of this Appendix, 
we consider the synthesis problem only as it relates to the 
results of the analysis problem. 
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B. 2. 


State-space Modeling of Integration Formulae 


This section presents the state-space discrete equations 
that describe the application of various numerical integration 
schemes to a continuous, linear system. The original, NXC 
dimensional system is described by Equation B-1. 

It is assumed that the input u(t) to Equation (B-1) is 
sampled every T sec, and it is further assumed that the integra- 
tion algorithm uses 

A 

u(t) = u^ = u(kT) for kT < t < (k+l)T 

i.e., u(t) is assumed piecewise-constant over the integration 
time-steps. The discrete-time equivalent of Equation (B-1) 
that describes the evolution of the system is given in a general 
form (B-3) . 

The dimension of the control and output vectors in the 
continuous and discrete- time models are the same. However, to 
allow for flexibility to consider high-order integration schemes 
we will not restrict and x(t) to have the same dimension 
(although they often will) . The matrices A^, B^ will be a func- 
tion of , B^ and T for a given integration scheme. Generally, 
= C^, in cases when continuous/discrete state dimensions are 
compatible. Below we give formulae for A^, B^ for several com- 
monly used integration schemes. 
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B . 2 . 1 O ne-Step Methods 


Transition Matrix Method 


This is an exact integration scheme under the assumption 
that u(t) is piecewise-cons tant. 

T. 


-K+1 


AT ^ /.Aq_ ^ 

= e-c X), + e^e-c da u,^ 


Thus, dim(xj^) = dim(x(t)) and 


A. = exp (AT) 


Bn = /exp(A a) B da 
-d o ^ -c -c 


(B-5a) 

(B-5b) 


Computation of Equation (B5) is via series summation for "small" T, 

(A T)N 


(A,T)2 (A T) 3 , 

^d = I + + -Ti— + • • • -1; 


®d = 


A T (A T) 2 

I + - + 


2! 


31 


(A^T)N-I 

n1 


B T 
-c 


(B-6a) 

(B-6b) 


Enter Integration 

This is perhaps the simplest integration scheme wherein 
x(t) is replaced by 


x(t) - (x^^i - X^)/T 


B-4 


Thus 


-k+1 


(I + A^T) + TB^ U,^ 


SO that 


A<i = (I + A^T) 

§d = 55e 


Runge-Kut ta 


(B-7a) 


(B-7b) 


This is the most common scheme for integrating nonlinear 
(homogeneous) equations 

X = f(x) 


Here, computed according to 

2^k+l = I + ^^2 + 2II3 + II4] 


where 


hj^ = Tf(Xj^) 

^2 = I ^3l> 

hj = Tf(Xj^ + I h^) 

h^ = Tf (Xj^ + h^) 

In the linear case, assuming u(t) is constant over the interval 
(k, k+1) , 

f(x) = A^x + 
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Successive substitutions of f (x) into the above equations gives 


X 


k+1 




2 2 


3 3 
T A*^ 


4 4 
T A 


I + 


KA + - 
-c 

21 - - 

31 - 

41 


2,2 

™3 3 X 


TA 

T A 

T A \ 

TB 

-if- 


-c 

41 / 



\ \ 

?-} 


X, 


(B-8) 


Therefore, Runge-Kutta is the same as the transition matrix method 
where N = 4 in the summation Equation (B-6) . Note that Euler 
method corresponds to N = 1 . 


Impl-ioit M'Cdpo'int 


For an arbitrary x = f(x) , implicit midpoint gives x^^^ 
according to 


^?k+l ■ 5k = 


For the linear case we can solve for explicitly 


Substitute for f (x) = A x + B u 

— c - -c - 


X 


AT AT 

-C , — C 

- X, = — X, + — :r- X, 


+ TB U, 


-k+1 -k 2 -k 2 -k+1 -c -k 


to obtain 


-1 


= (I - T/2)x 


-1 


(B-9) 


+ (I - T/ 2 ) ^ TB^ 
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Thus , 




-1 


= (I - A T/2) (I + A T/2) 


(B-10) 


= I + A T(^ - A T/2) 


-1 




-1 


= (I - A T/2) TB 


(B-11) 


S'tmp'L'i fied IntegTat-ion 

In this method the transfer function for ‘ X - r is considered 


and the "integrators" 1/s are replaced by 


u(s) 


1 

s 


l^z-1^ 


(B-12) 


thus yielding a discrete differential equation, or z transfer 
function. It is necessary to then find a state-space realization 
for the transfer. Since 

H(s) = C^(sl - A^)”^ ic 
substituting 


s = - (z-1) gives 


H(z) = C [zl - (^ + AT)] 


-1 


TB 

-c 


This z-transfer function is realized by 


Sd = 2c 
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-d -c 


A. = (I + AT) 


i.e., the same as Euler's method — to no surprise 


Tustin Method 


In this approach, a better approximation than Equation 
(B-12) to 1/s is used, namely 



If Equation (B-13) is substituted into H (s) , or equivalently 
into 


s x(s) = A^ x(s) + B^ u(s) (B-14 

y{s) = x(s) 

it is easy to see that both numerator and denominator terms in 

NXC 

H(z) will have powers of z . This means that to find a reali- 

zation of the equivalent H(z) transfer function we require 

i.e., we need during the interval (k, k+1) in which we are 

computing Clearly, this is not feasible in the feedback, 

or control context, and the Tustin method will not be pursued 


B-8 



any further. Note that the Tustin method is exactly equiva- 
lent to the implicit trapezoidal method where 


^k+l - 2k = 2 


and 


f(2?k+l) = + ic !^k+l 


B . 2 . 2 Two-step Methods 


It is fairly clear that implicit integration methods will 
not prove useful for cases when there is an independent, unknown 
a pri-ori , input u(t). This is unfortunate since the Equation 
(B-13) approximates 1/s well', i.e., for low frequencies 


T e +1 ~ l+sT/2+s T /4+. . . ~ 1 (B-15) 

^ l+sT/2+s^T^/6+. . . ® 


Expli-cit Trapezoidal 


The problem with the above is the need for u^ and 
at time k. One way to amend this is to accept a one step delay 
and use instead ^ and at time k. This scheme is referred 
to as the explicit trapezoidal, or modified Tustin, 


2k+l -2k = f (B-16) 


wherein 

1 T (z+1) 

s ^ 2 z (z-1) (B-17) 
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For low frequencies 


T 1+z ^ l-sT/2 . » . 

2 z-1 ~ s 1+ST/2+... 

i.e. , an integrator with a T second delay, as anticipated. 

In order to find the discrete-time state-space representa- 
tion for this method, we substitute f (x) into Equation (B-16) 

2k+l ■ 2k = 2?k ic !^k’ 2k-l + 5c Bk-1> 


where c^ = T/2 , C 2 = T/2. Since 


X, ,,-(I+c, A)x, - c^A X, ,=C-B u, +c„B u, T 
“k+1 “ 1 -c — k 2 -c -k-1 1 -c -k 2 -c -k-1 


Ik 


= c 

-c 


2k 


(B-18) 


it can be seen that the equation cannot be represented by means 
of an NXC-order discrete system. We need Xj^ and time k 
so that we require a 2 NXC order model. A suitable representa- 
tion that is convenient for our work is 



(B-19a) 


(B-19b) 


C 


d 
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This form is chosen so that the first NXC component of x 
the vector By taking the z-transform of Equation (B-19) , we 

can readily verify that Xj^ satisfies Equation (B-18) -as required. 
Other forms of B^, C^} can be obtained via similarity trans- 

formations. This approach yields some insight as to the modal 
structure of the discrete system — there are now two NXC modes — 
NXC approximate the original modes and NXC modes are "fast", 
i . e . , of order T . 

Adams-Bash forth 


The idea behind this method is to ameliorate the inherent 
delay of the explicit trapezoidal scheme. Here, we obtain 
according to 

X, , T - X, = T(f, + i Af + A^f +...) 

-k+1 -k “k 2 -k 12 -k 


where V is the backward difference operator V f k - fk - fk-1. 
For a two-step method we have 


-k+1 


^k 


T 


3 

2 




1 

2 


^^^k-1) 


(B-2Q) 


which corresponds to the replacement 


1 T 3z-l 

s 2 z ( z-1) 


(B-21) 


For low frequencies this gives 

l+sT/2-s^T^/4 
l+sT/2+s^T^/6 

which is a compromise between Tustin (unachievable) and explicit 
trapezoidal . 


T 3-z ^ = 1 
2 (z-1) s 
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To find the discrete model for the Adams-Bashforth method 
we substitute f(x) = x + u into Equation (b- 20) and expand. 
If we define 

= 3T/2, C 2 = -T/2 

the resulting equations are in exactly the form of Equation 
Thus, Equations (B-19a) - (B- 19b) serve as the discrete model, 
the proper definitions of c^ and C 2 ■ Note that we can model 
integrator replacement of the form 


s z ( z-1 ) 

by the above method. 

B.3 The Analysis Problem 

The analysis problem is to determine how well the discrete 
integration schemes (operating at fixed sample-rates due to 
real-time constraints) mimic the continuous system. One approach 
to this analysis is to consider the difference between outputs 
of the "actual" and "simulated" systems for a given input. This 
kind of "error analysis" is carried out, for example, in Rosko 
[2]. The difficulty with this approach is that it is input 
dependent. We would like results that do not depend explicitly 
on the input and, moreover, that are relevant to closed-loop 
analysis. For these reasons, we examine the relationship between 
the continuous and discrete transfer functions. 


(B-18) . 

with 

any 
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We define the "distortion function", D..(s), introduced 

J 

by the discrete integration scheme by the following relation 

Di . (s) = (s) (B-22) 

J ij ij 

where and are defined in (B-2) and (B-4) and the sub- 
d c 

scripts i and j refer to output and input, respectively. That 
is, is the transfer function relating the i^^ output to 

the input. The definition of Equation (B-22) is straight- 

forward with respect to single input systems, whether they 
involve a single output or multiple outputs. Furthermore, the 
determination of the distortion function in these cases may 
be helpful in solving the corresponding synthesis problem, 
especially if the distortion function is of a simple form (e.g., 
a constant gain and pure delay) . For the case of multiple 
inputs, the definition provides analytic insight but it does 
not address the synthesis problem because it ignores interac- 
tions that are essential to reproducing the overall input/output 
relations . * 

It should be noted that because the definition is in terms 
of transfer functions, the distortion will be independent of 
the state-space representation. 


* For this case, it is probably best to approximate directly 

without attempting to relate the approximation to the original 

continuous transfer matrix H . 

c 
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B.4 Results 


A computer program was developed to compute distortion 
results for several of the integration schemes discussed in 
section B.2. The results are summarized below. The following 
shorthand notation is used in the sequel to identify the inte- 
gration schemes: 

EU : Euler 

TM : Transition Matrix 
RK : Runge-Kutta 
IM : Implicit Midpoint 
AB : Adams-Bashforth 

B.4.1 Inteqration (H (s) = -]-) 

Here A =0,B =C=1. Simple analysis of the Integra- 

c c c 

tion schemes shows that the TM, EU, RK and IM methods yield 
identical discrete transfer function H^(s) and should yield 
identical distortion results D(s) . This was verified to be 
the case. The magnitude and phase distortion results obtained 
are plotted vs. a normalized frequency in Figure B-1. 

For this case, the normalized magnitude and phase distortion 
results are independent of the sampling frequency. 

B.4. 2 Computation of D(s) for H^(s) =gjrp 

The details of computation will, of course, depend on the 
integration scheme used. For illustrative purposes, let us 
consider the Euler scheme. Any other scheme may be worked out 
similarly. Here we are approximating 
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Figure BIB Distortion Results for Integration (H^(s) = 1/s). 



y 


py + u 


by 


^k+i = + <"py + 


Thus 


H^(S) 


1 

s+p 


and 


Hd(s) 


T 

z-1 + pT 


z=exp ( sT) 


so that 


D(s) (S+P)'f 

exp (sT) -1+pT 


From 


D( joo) 


( j(jgT+pT) 
exp ( jcoT) -1+pT 


(B-23) 


it is easy to compute the magnitude and phase distortions as 




D ( j03) 


Dp(jw) = Arctan{ 


Imag. part Ddo)) -. 
Real part D(joj) 


These are plotted in Figure B.2. 
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Figure B2A. - Distortion Results for First 

Order Dynamics (H^(s) = 1/s+p). 
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B.4.3 Computation of D(s) for H^(s) = (s + z) 


Again we shall illustrate only the Euler scheme. We are 
approximating 

u = - zu + y 


by 


u 


k+1 





zu, ) T 
k 


It follows that 


D(s) 


= e^'^-l+zT 
(s+z) T 


(B-24) 


which is simply the reciprocal of the result for = s+p 
with p E z. Hence, the magnitude distortion for a zero is 
simply the reciprocal of that for a pole; the phase distortion 
for a zero is negative of that for a pole. 


B.4.4 Computation of D(s) for any H^(s) 


We note that any H^(s) may 
m 


Hc(s) = 


3 . tt (s + z ) 


n 

7T (s+p . ) 


j=l 


be written in the factored form 


(B-25) 
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Some of the and may be zero or complex, the latter, of 
course, occurring in conjugate pairs. It then follows easily 
that* 


D (H (s)) 
m c 


D 

P 



(s) ) 


n 

n D 

j=i 


m 




(B-26) 


(B-27) 


The result in (B-23) , of course, is true for p real, complex 
or zero. Writing p = a + jo) we have 


D 


(0T) ^ + ( (o)+a))T) ^ 


m s+p 


2 

(aT-l+cos coT) 


/- - X 2 

+ (coT+sin wT) 


(B-28) 


and 


D 


P 


1 

s+p 


Arctan 


^ (lo+cj ) T 
qT 


(B-29) 


-Arctan 


coT+sin (jjT j 
aT-l+cos coT 


(B-30) 


We may hence also compute the effective time delay for any 
transfer function using (B-29) as 


* We abuse notation here and write D_(H (s) ) to denote D_(oj) for 

.m.c m 

the transfer function H^(s) and similarly for Dp(H^(s) ; . 
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(B-31) 


n 


T (H (S)) = 2 T 

D=1 


1 

m 

T T 

1 ] 

[s+p^ - 

• 1 d 

s+z . 

1-1 

1/ 


where sTp effective delay associated with a pole at 

p. , etc . ^ 

3 

Thus, the effective delay for transfer function H^(s) can 
be bounded by 


-m T 


i t^(H^(s)) < n 


B . 4 . 5 F -8 Dynamics 


The aforementioned computer program was used to obtain 
distortion results for various unaugmented configurations of 
the F-8 dynamics corresponding to Flight Condition #11 [21] . 

Results for the various integration schemes are given as a 
function of frequency in Figures B-3 - B-6* where the plot 
symbols E, A, T and X respectively denote Euler, Adams-Bashforth , 
Transition matrix and Explicit trapezoidal integration. '(Transi- 
tion matrix and explicit trapezoidal results are shown only for 
the longitudinal short period dynamics.) 


* The use of a normalized frequency is not convenient for 
dynamics other than pure integration 

distortion versus normalized frequency is no longer covariant 
with sample frequency. 
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c) Pitch/Elevator Magnitude Distortion at T = 1/32 
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a) Roll Angle/Aileron Magnitude Distortion at T = 1/10. 
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Figure B4 Distortion Results for Lateral CAS-OFF F8 Dynamics* 
d) Roll Angle/Aileron Phase Distortion at T = 1/32. 
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Distortion Results for Lateral CAS-OFF F8 Dynamics, 
a) Roll Error/Rudder Magnitude Distortion at T = 1/10. 
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Figure B5. - Distortion Results for Lateral CAS-OFF F8 Dynamics- 
b) Roll Error/Rudder Phase Distortion at T = 1/10- 
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Distortion Results for Lateral CAS-OFF F8 Dynamics, 
c) Roll Error/Rudder Magnitude Distortion at T = 1/32 
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Figure B6. - Distortion Results for Coordinated F8 Dynamics. 

a) LOS Error/Aileron Magnitude Distortion at T = 1/10. 
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Figure B6. — Distortion Results for Coordinated F8 Dynamics. 

b) LOS Error/Aileron Phase Distortion at T = 1/10. 
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Figure B 6 Distortion Results for Coordinated F 8 Dynamics. 

c) LOS Error/Aileron Magnitude Distortion at T = 1/32. 
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Figure B6. - Distortion Results for Coordinated F8 Dynamics. 

d) LOS Error/Aileron Phase Distortion at T = 1/32. 
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Figure B6 Distortion Results for Coordinated F8 Dynamics, 

e) Roll Angle/Aileron Magnitude Distortion at T = 1/10, 
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Figure B6. ~ Distortion Results for Coordinated F8 Dynamics. 

f) Roll Angle/Aileron Phase Distortion at T = 1/10, 





+ 15 Gain in DB -15 


+ sfc !f}: 5S: + 

+ + 


=te + 
+ 


+ =s==ifc=tt:=fe + =fe={?:=tt:=fc + + + =Sfc=}}:^=ii: 

+ + + + m + 


m 


m 


m > 

+ PI 

m PI > 
m tT3 m > 

m m rrj m > ?> 

mmmtDtntn >>>> 


FI > 
F] > 


/ 


.1 


+ + 

Figure B6. - 


+ + + + + 

=fe=^fe5!fc=fe + :fc=fe=fe=*: + 4i==4te=^4:5!te + =i*:=tte=J$:=te + =t}==fe=!te=fe + =fe==fe=St==ife 

1 Frequency in Rad/Sec 10 

Distortion Results for Coordinated F8 Dynamics, 
g) Roll Angle/Aileron Magnitude Distortion at T 


+ 

+ 


100 

1/32. 


####//+####+####+####+####+####+####+####+####+####+####+##### 



##/^# #+#### + ####+####+#### + #### + + + + 

+ ')80 Phase in Degrees -180 


+ =!i=^^=S: + =!^^=^^^=^}:=ife + =fe=^te 

+ + + 


=t!= + =fe =tfc =t{= =Ws + 
+ + 


+ =ite =& 

+ 


m 


+ 




+ 




n 


+ 


+ 


+ 


m + 


mrrimmi-nm >> 

tn tn > > 

m m 

Fl > 

+ m tp* 

tn > 

tn m 




> + 




m 






m 


w 


m 


.1 


+ 

=fe =fe + 


+ + + 

=^^:=fe + =fe=fe=:fe=:fe + + =fe=^=fe 

1 Frequency in Rad/Sec 


+ 

+ =fe 


10 


+ m + 

=fe + 5^*=5feSfe=Si + ^ 


Figure B6 


Distortion Results for Coordinated F8 Dynamics, 
h) Roll Angle/Aileron Phase Distortion at T = 1/32. 


100 


V // # # # + // # # # + # # # # + // # # # # # # ^1= # # # # ■*■ + // # # 3 + # # # # # 



APPENDIX C 


STATE EQUATIONS FOR F-8 DYNAMICS 


In this Appendix, the state variables and state equations 
for the various F -8 configurations analyzed in the text are 
presented. In general, the state variable description is 


x = Ax + Bu + Ew 
y = C X + D u 


(C-1 


The state and output variables are not unique and may be 
defined in various ways. The definitions used in the analyses 
conducted here and the appropriate system matrices for (C-1) 
are given below. 


C.l Longitudinal Dynamics 


Xi: 

dummy variable (used in generating target motion) 

^ 2 * 

(ft) 


^3 ■ 

h^ (ft/sec) 

X4: 

g (deg/sec) 

X 5 : 

CL (deg) : 

angle of attack 


0 (deg) : 

pitch angle 

x^: 

h (ft) : 

deviation from nominal altitude 


C-1 



The output variables were selected to be 


= R tracking error (ft.) 

Y 2 = R tracking error-rate (ft/sec) 

= 0 (deg) : pitch angle 

y^ = q (deg/sec) : pitch rate 

y^ = n^ (q) ; normal acceleration 
2 

Yg = h^ (ft/sec ): target normal acceleration 


For the analysis y^ - y^ are observed by the pilot. Normal 
acceleration n^, is a response variable of some interest and 
the target's normal acceleration is included as an output for 
convenience . 


The state equations corresponding to the above definitions 
are given in Figure C-1 for the wideband target motions. For 
the narrowband target motion the equations are modified simply 
by letting 

a^2 = -.04, a^2 “ -.2828, c^2 ~ .04, c^^ = .2828. 


The system matrices for the longitudinal CAS-ON dynamics 

are given in Figure C-2. The three additional states Xg- 

are CAS-states. The remaining variables are defined as before, 

2 

except the pilot's input now has units of ft/sec . 
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C.2 Lateral Dynamics 


The states, controls and outputs are defined as follows 
for lateral tracking with unaugmented dynamics. 

= dummy variable 
(deg) 

X4 = p (deg/sec) 
x^ = r (deg/sec) 

Xg = B (deg) 

= (f) (deg) 

Xq = -[jj (deg) 

X9 = R (ft) 

^1 ^ *^a 

Yl = (1>T - 

• « 

^2 ^ (^^g/sec) 

Ys = R 

Y4 = R e.p (ft/sec) 
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= <j) (deg) 

= (f) (deg/sec) 

(ft/sec^) 
yg = r (deg/sec) 

The corresponding system matrices are displayed in Figure C-3. 

For the lateral CAS, one state is added for model-following 
Xio = Pj^ (deg/sec) . Two output responses are added to those 
above, viz. 

yg = 6^^ (deg) 

^10 = '^RC 

The resulting system matrices are given in Figure C-4. 

Finally, for the coordinated dynamics, the system matrices 
are given in Figure C-5, where 

Xt - X- defined as above 
1 4 

= (p (deg) 

Xg = 4; (deg) 

X7 = R ^T 

y^ - yg defined as above 
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TOTAL NOISE STATES= 3 




A 

MATRIX: 






-1 . OOOE+00 

0. 

0. 

0. 

0. 


0. 

0. 





0. 

0. 

1 . OOOE+00 

0. 

0. 


0. 

0. 





1 .OOOE+00 

-2.500E-01 

-7.070E-01 

0. 

0. 


0. 

0. 





0. 

0. 

0. 

-4.870E-01 

-4.789E+00 


0. 

0. 





0. 

0. 


1 . OOOE+00 

-8. 360E-01 


0. 

0. 





0. 

0. 

0. 

1 .OOOE+00 

0. 


0. 

0. 





0. 

0. 

0. 

0. 

-1 .086E+01 


1 .086E + 01 

0. 




B 

MATRIX: 

E 

MATRIX: 




0. 

1 . 

OOOE+00 




0. 

0. 





0. 

0. 





-8.743E+00 

0. 





-1 . 110E-01 

0. 





0. 

0. 





0. 

0. 




C 

MATRIX: 






0. 

1 .OOOE+00 

0. 

0. 

0. 


-1 .047E+01 

-1 .OOOE+00 





0. 

0. 

1 .OOOE+00 

-1 .047E+01 

1 .086E+01 


-1 .086E + 01 

0. 





0. 

0. 

0. 

0. 

0. 


1 .OOOE + 00 

0. 





0. 

0. 

0. 

1 . OOOE+00 

0 . 


0. 

0. 





0. 

0. 

0. 

0. 

2.818E-01 


0. 

0. 





-1 . OOOE+00 

2.500E-01 

7.070E-01 

0. 

0. 


0. 

0. 





D MATRIX: 

0 . 

0 . 

0 . 

0 . 

3.735E-02 

0 . 

Figure Cl State Representation for Longitudinal 
Wide-Band Tracking Task (CAS-OFF). 
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TOTAL NOISE STATES= 3 
A MATRIX: 


■1 .OOOE+00 
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0. 

1 .OOOE+00 
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0. 
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0. 

-4.870E-01 
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0. 

0. 

1 .OOOE+00 
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0. 

0. 
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0. 

0. 

0. 

1 .OOOE+00 

0. 

0. 

0. 

0. 

0. 

0. 

0. 

0. 

0. 

0. 

-1 .086E+01 
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0. 

0. 
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0. 
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0. 
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0. 
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0. 

0. 

0. 

0. 

7. 957E+00 

-3.251E+01 

0. 

0. 
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2.380E+00 

-3.540E+00 

MATRIX: 


E MATRIX: 



0. 


1 .OOOE+00 



0. 


0. 



0. 


0. 



2.323E-01 


0. 



2.949E-03 


0. 



0. 


0. 



0. 


0. 



5.500E+01 


0. 



0. 


0. 



2.549E+00 


0. 



Figure 

C2.- State Representation for Longitudinal 



Wide-Band Tracking 

Task (Pitch 

CAS -ON). 
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MATRIX: 
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0. 

-1 .047E+01 

-1 .OOOE+00 

0. 

0. 

0. 

0. 

0. 

1 .OOOE+00 

-1 .047E+01 

1 .086E+01 

-1 .086E+01 

0. 

0. 

0. 

0. 

0. 

0. 

0. 

0. 

0. 

1 .OOOE+00 

0. 

0. 

0. 

0. 

0. 

0. 

0. 

1 .OOOE+00 

0. 

0. 

0. 

0. 

0. 

0. 

0. 

0. 

0. 

2.086E-12 

2.818E-01 

0. 

0. 

1 . 130E-04 

0. 

1 .378E-03 

0. 

0. 

0. 

0. 

0. 

0. 

0. 

3.026E-03 

0. 

3.690E-02 


D 


MATRIX 


922E-04 

657E-02 


Figure C2. -State Representation for Longitudinal 
(cont.) Wide-Band Tracking Task (Pitch CAS-ON), 
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TOTAL NOISE STATESr 3 
A MATRIX: 


1 . OOOE+00 

0. 

0. 

0. 

0. 

0. 

0. 

0. 

0. 


1 .OOOE+00 

-1 .OOOE+00 

0. 

0. 

0. 

0. 

0. 

0. 

0. 


0. 

5. 173E-02 

-1 .OOOE-02 

0. 

0. 

0. 

0. 

0. 

0. 


0. 

0. 

0. 

■2.580E+00 

2. 

3.778E+01 

0. 

0. 

0. 


0. 

0. 

0. 

7.530E-02 

-2. 

4. 360E+00 

0. 

0. 

0. 


0. 

0. 

0. 

7 . 800E-02 

-9. 

2.290E-01 

5. 173E-02 

0. 

0. 


0. 

0. 

0. 

9. 970E-01 

7. 

0. 

0. 

0. 

0. 


0. 

0. 

0. 

0. 

1 . 

0. 

0. 

0. 

0. 


0. 

0. 

1 .086E+01 

0. 

-1 . 

1 .086E+01 

0. 

-1 .086E + 01 

0. 


MATRIX: 


E MATRIX: 



0. 

0. 

1 . OOOE + 00 


0. 

0. 

0. 



0. 

0. 

0. 



1 .724E+01 

7. 016E+00 

0. 



8. 160E-01 

-3. 180E+00 

0. 



0. 

4.560E-02 

0. 



0. 

0. 

0, 



0. 

0. 

0. 



0. 

0. 

0. 




Figure C3.— State Representation for Unaugmented 
Lateral Dynamics. 
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MATRIX: 
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0. 
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0. 
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0. 
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0. 
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0. 


0. 

0. 

0. 
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0. 

0. 
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0. 


0. 
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0. 

0. 
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0. 


0. 
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0. 
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0. 
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Figure C3. —State Representation for Unaugmented 
(cont.) Lateral Dynamics. 
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TOTAL NOISE STATES= 3 
A MATRIX: 


-1 .OOOE+00 

0. 

0. 
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0. 
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0. 
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0. 

0. 
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0. 

0. 
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0. 

0. 

0. 
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-9.591E-01 

-2.442E-01 

4.993E-02 

0. 

0. 

2.018E-04 

0. 

0. 

0. 

9.970E-01 

7.800E-02 

0. 

0. 

0. 

0. 

0. 

0. 

0. 

0. 

0. 

1 .OOOE+00 

0. 

0. 

0. 

0. 

0. 

0. 

0. 

1 , 086E+01 

0. 

-1 .047E+01 

-1 .086E+01 

0. 

-1 .086E + 01 

0. 

0. 

0. 

0. 

0. 

0. 

0. 

0. 

0. 

0. 

0. 

-5.000E+00 


B MATRIX: 

0 . 

0 . 

0 . 

-8.575E+00 

3.887E+00 

-5.573E-02 

0 . 

0 . 

0 . 

5. OOOE+00 


E MATRIX: 
1 . OOOE+00 

0 . 

0 . 

0 . 

0 . 

0 . 

0 . 

0 . 

0 . 

0 . 


Figure C4 State Representation for Augmented 
Lateral Dynamics. 
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MATRIX: 
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0. 
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0. 
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0. 

0. 
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0. 

0. 

0. 

1 .OOOE+00 


0. 

0. 

0. 

0. 


0. 

0. 
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0. 

0. 
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0. 

0. 
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Figure 4.— State Representation for Augmented 
(cont.) Lateral Dynamics. 
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TOTAL NOISE STATES= 3 




A 

MATRIX: 
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0. 

0. 

0. 
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0. 
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0. 

0. 

0. 


0. 
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0. 
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0. 

0. 


0. 
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0. 

0. 

0. 
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0. 

0. 





0. 

0. 

0. 
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0. 

0. 





0. 

0. 

0. 

0. 
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0. 
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0. 
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MATRIX: 

E MATRIX: 
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0. 
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0. 
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0. 
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0. 

0. 





0. 

0. 
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MATRIX; 






0. 
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0. 

0. 
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1 .OOOE+00 

-1 .OOOE+00 

0. 

-9.970E-01 

-4. 100E-03 


0. 

0. 





0. 

0. 

0. 

0. 

0. 


0. 

1 .OOOE+00 





0. 

0. 
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0. 

-5.420E-01 


-1 .086E+01 

0. 





0. 

0. 

0. 

0. 

1 .OOOE+00 


0. 

0. 





0. 

0. 

0. 
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4. 100E-03 


0. 

0. 




D 

MATRIX: 






0 . 

0 . 

0 . 

0 . 

0 . 

0 . 


Figure C5. - State Representation for Coordinated 
Lateral Dynamics. 
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